-- Logs begin at Wed 2022-08-24 03:28:07 UTC, end at Wed 2022-08-24 04:28:08 UTC. -- Aug 24 03:59:27.726117 dv-osbrick-854281-1-ceph systemd[1]: Starting Devstack devstack@keystone.service... Aug 24 03:59:27.735967 dv-osbrick-854281-1-ceph devstack@keystone.service[88423]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 24 03:59:27.737822 dv-osbrick-854281-1-ceph devstack@keystone.service[88423]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 03:59:27 2022] *** Aug 24 03:59:27.737822 dv-osbrick-854281-1-ceph devstack@keystone.service[88423]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 03:59:27.737822 dv-osbrick-854281-1-ceph devstack@keystone.service[88423]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 03:59:27.737822 dv-osbrick-854281-1-ceph devstack@keystone.service[88423]: nodename: dv-osbrick-854281-1-ceph Aug 24 03:59:27.737822 dv-osbrick-854281-1-ceph devstack@keystone.service[88423]: machine: x86_64 Aug 24 03:59:27.737822 dv-osbrick-854281-1-ceph devstack@keystone.service[88423]: clock source: unix Aug 24 03:59:27.737822 dv-osbrick-854281-1-ceph devstack@keystone.service[88423]: pcre jit disabled Aug 24 03:59:27.737822 dv-osbrick-854281-1-ceph devstack@keystone.service[88423]: detected number of CPU cores: 4 Aug 24 03:59:27.737822 dv-osbrick-854281-1-ceph devstack@keystone.service[88423]: current working directory: / Aug 24 03:59:27.737822 dv-osbrick-854281-1-ceph devstack@keystone.service[88423]: detected binary path: /usr/bin/uwsgi-core Aug 24 03:59:27.737822 dv-osbrick-854281-1-ceph devstack@keystone.service[88423]: your processes number limit is 47680 Aug 24 03:59:27.737822 dv-osbrick-854281-1-ceph devstack@keystone.service[88423]: your memory page size is 4096 bytes Aug 24 03:59:27.737822 dv-osbrick-854281-1-ceph devstack@keystone.service[88423]: detected max file descriptor number: 2048 Aug 24 03:59:27.737822 dv-osbrick-854281-1-ceph devstack@keystone.service[88423]: lock engine: pthread robust mutexes Aug 24 03:59:27.737822 dv-osbrick-854281-1-ceph devstack@keystone.service[88423]: thunder lock: enabled Aug 24 03:59:27.739424 dv-osbrick-854281-1-ceph devstack@keystone.service[88423]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 24 03:59:27.739424 dv-osbrick-854281-1-ceph devstack@keystone.service[88423]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 03:59:27.782922 dv-osbrick-854281-1-ceph devstack@keystone.service[88423]: Python main interpreter initialized at 0x55c2191e49c0 Aug 24 03:59:27.782922 dv-osbrick-854281-1-ceph devstack@keystone.service[88423]: python threads support enabled Aug 24 03:59:27.782922 dv-osbrick-854281-1-ceph devstack@keystone.service[88423]: your server socket listen backlog is limited to 100 connections Aug 24 03:59:27.782922 dv-osbrick-854281-1-ceph devstack@keystone.service[88423]: your mercy for graceful operations on workers is 90 seconds Aug 24 03:59:27.783371 dv-osbrick-854281-1-ceph devstack@keystone.service[88423]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 03:59:27.783371 dv-osbrick-854281-1-ceph devstack@keystone.service[88423]: *** Operational MODE: preforking *** Aug 24 03:59:27.783662 dv-osbrick-854281-1-ceph devstack@keystone.service[88423]: *** uWSGI is running in multiple interpreter mode *** Aug 24 03:59:27.783662 dv-osbrick-854281-1-ceph devstack@keystone.service[88423]: spawned uWSGI master process (pid: 88423) Aug 24 03:59:27.783932 dv-osbrick-854281-1-ceph systemd[1]: Started Devstack devstack@keystone.service. Aug 24 03:59:27.785130 dv-osbrick-854281-1-ceph devstack@keystone.service[88423]: spawned uWSGI worker 1 (pid: 88431, cores: 1) Aug 24 03:59:27.785130 dv-osbrick-854281-1-ceph devstack@keystone.service[88423]: spawned uWSGI worker 2 (pid: 88432, cores: 1) Aug 24 03:59:27.785130 dv-osbrick-854281-1-ceph devstack@keystone.service[88423]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 03:59:32.432093 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:59:32.432093 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: from cryptography.utils import int_from_bytes Aug 24 03:59:32.432957 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:59:32.432957 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: from cryptography.utils import int_from_bytes Aug 24 03:59:32.433384 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:59:32.433384 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: from cryptography.utils import int_from_bytes Aug 24 03:59:32.433492 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:59:32.433492 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: from cryptography.utils import int_from_bytes Aug 24 03:59:32.483137 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 03:59:32.483450 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 03:59:32.483607 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 03:59:32.483770 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] command line args: [] {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 03:59:32.483908 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 03:59:32.483908 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] command line args: [] {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 03:59:32.484155 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 03:59:32.484155 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ================================================================================ {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 03:59:32.484391 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 03:59:32.484391 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ================================================================================ {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 03:59:32.484641 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] admin_token = **** {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.484802 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] admin_token = **** {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.484918 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] config_dir = [] {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.484918 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.485131 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] config_dir = [] {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.485239 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] config_source = [] {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.485343 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.485459 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] debug = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.485587 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] config_source = [] {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.485587 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] debug = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.485794 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.486262 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.486488 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.486665 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.486840 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.487005 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.487177 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.487415 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.487571 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.487704 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.487841 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] list_limit = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.487979 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] list_limit = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.488116 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] log_config_append = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.488254 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] log_config_append = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.488399 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.488525 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.488659 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] log_dir = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.488788 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] log_dir = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.488917 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] log_file = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.489044 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] log_file = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.489181 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.489307 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.489440 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.489568 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.489701 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.489839 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.489977 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.490112 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.490240 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.490368 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.490452 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.490608 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.490731 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.490905 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.490905 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.491183 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.491340 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.491490 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.491679 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.491774 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.491904 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.491980 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.492120 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.492211 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.492278 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.492352 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.492412 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.492467 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.492529 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.492642 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.492744 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.492844 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.492931 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] publish_errors = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.492999 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] publish_errors = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.493115 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.493189 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.493262 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.493335 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.493395 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.493467 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.493575 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.493715 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.493798 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.493860 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.493929 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] standard_threads = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.494022 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] standard_threads = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.494144 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.494231 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.494362 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.494442 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.494514 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.494584 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.494584 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] use_journal = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.494714 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] use_journal = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.494792 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] use_json = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.494863 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] use_json = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.494927 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] use_stderr = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.494990 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] use_stderr = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.495062 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] use_syslog = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.495142 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] use_syslog = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.495302 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.495432 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:59:32.495563 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.495707 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.495836 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.495978 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.496159 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.496262 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.496362 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.496485 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.496663 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.496797 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.496904 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.497007 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.497104 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.497207 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.497309 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.497415 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.497518 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.497615 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.497710 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.497804 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.497899 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.498002 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.498104 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.498228 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.498374 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.498491 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.498571 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.498647 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.498767 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.498843 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.498956 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.499049 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.499149 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.499349 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.499431 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.499549 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.499626 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.499761 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.499887 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.500027 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.500137 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.500277 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.500361 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.500487 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.500564 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.500687 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.500764 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.500883 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.500966 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.501081 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.501163 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.501285 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.501363 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.501477 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.501558 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.501625 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.501698 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.501764 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.501828 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.501897 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.501968 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.502032 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.502104 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.502176 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.502251 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.502341 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.502459 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.502587 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.502709 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.502791 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.502859 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.502940 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.503007 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.503070 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.503150 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.503248 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.503366 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.503443 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.503514 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.503630 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.503783 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.503926 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.504040 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.504172 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.504296 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.504420 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.504565 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.504670 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.504793 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.504876 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.504991 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.505067 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.505067 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.505251 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.505372 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.505448 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.505568 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.505651 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.505773 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.505871 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.506000 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.506131 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.506253 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.506364 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.506498 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.506575 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.506689 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.506772 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.506886 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.506994 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.507078 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.507253 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.507333 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.507447 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.507523 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.507622 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.507712 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.507786 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.507901 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.508001 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.508128 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.508298 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.508409 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.508495 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.508615 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.508702 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.508702 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.508895 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.509011 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.509088 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.509231 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.509318 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.509447 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.509559 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.509684 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.509810 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.509956 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.510051 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.510172 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.510249 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.510363 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.510452 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.510569 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.510645 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.510759 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.510847 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.510959 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.511088 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.511166 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.511295 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.511394 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.511485 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.511588 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.511679 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.511742 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.511807 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.511867 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.511971 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.512062 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.512174 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.512251 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.512374 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.512457 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.512572 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.512649 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.512872 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.513177 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.513292 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.513390 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.513486 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.513595 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.513691 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.513830 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.513916 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.514069 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.514158 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.514304 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.514514 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.514634 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.514810 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.514938 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.515134 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.515321 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.515419 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.515503 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.515624 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.515704 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.515770 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.515842 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.515901 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.516015 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.516132 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.516241 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.516365 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.516478 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.516582 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.516713 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.516851 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.516983 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.517116 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.517246 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.517355 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.517431 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.517567 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.517700 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.517842 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.517941 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] auth.external = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.518071 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.518215 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.518347 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.518347 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] auth.external = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.518529 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.518683 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.518825 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.518825 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] auth.password = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.519068 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.519219 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] auth.token = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.519328 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.519442 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.519584 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] auth.password = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.519714 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.519846 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] auth.token = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.519975 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.520143 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.520229 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.520351 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.520430 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.520547 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.520634 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.520751 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.520829 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.520978 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.521092 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] credential.caching = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.521171 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.521171 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.521385 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.521468 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] credential.caching = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.521583 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.521583 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.521767 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.521853 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.521957 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.522042 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.522159 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.522237 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.522352 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.522439 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.522555 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.522632 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.522756 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.522886 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.523022 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.523138 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.523253 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.523329 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.523465 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.523619 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.523772 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.523867 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.523952 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.524072 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.524195 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.524325 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.524459 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.524610 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] federation.caching = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.524700 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.524822 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.524901 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.525017 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.525094 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] federation.caching = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.525214 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.525323 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.525433 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.525576 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.525701 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.525821 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.525968 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.526051 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.526172 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.526282 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.526370 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.526553 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.526777 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.526907 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.527002 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.527079 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.527262 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.527352 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.527501 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] identity.caching = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.527708 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.527820 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.527942 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.528020 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.528239 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] identity.caching = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.528323 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.528441 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.528518 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.528635 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.528729 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.528853 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.528985 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.529130 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.529263 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.529381 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.529468 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.529599 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.529680 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.529797 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.529876 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.529999 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.530078 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.530248 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.530349 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.530511 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.530608 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.530729 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.530807 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.530932 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.531011 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.531121 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.531273 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.531353 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.531469 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.531561 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.531637 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.531754 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.531839 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.531955 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.532083 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.532175 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.532292 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.532371 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.532489 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.532567 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.532681 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.532768 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.532892 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.533003 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.533130 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.533236 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.533349 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.533472 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.533600 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.533721 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.533842 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.533960 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.534040 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.534170 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.534249 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.534389 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.534480 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.534635 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.534722 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.534877 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.534957 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.535101 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.535207 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.535374 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.535506 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.535657 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.535759 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.535881 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.535960 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.536095 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.536195 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.536344 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.536424 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.536541 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.536620 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.536761 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.536889 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.537011 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.537133 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.537253 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.537379 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.537508 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.537633 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.537633 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.537877 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.538012 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.538118 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.538190 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.538312 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.538401 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.538471 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.538587 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.538665 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.538765 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.538844 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.538969 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.user = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.539049 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.539165 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.539307 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.539418 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.539539 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.539645 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.539732 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.user = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.539882 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.539970 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.540127 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.540233 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.540358 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.540450 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.540586 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.540670 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.540794 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.540881 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.541028 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.541113 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.541258 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.541369 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.541485 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.541575 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.541701 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.541786 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.541940 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.542026 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.542233 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.542333 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.542466 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.542552 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.542705 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.542791 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.542944 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.543040 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.543170 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.543385 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.543464 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.543579 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.543658 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.543785 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.543866 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.543981 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.544095 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.544186 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.544325 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.544419 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.544566 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.544652 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.544808 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.544895 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.545039 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.545139 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.545289 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.545375 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.545516 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.545604 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.545756 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.545851 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.545987 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.546072 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.546205 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.546321 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.546442 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.546581 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.546711 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.546845 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.546961 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.547039 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.547161 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.547277 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.547398 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.547476 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.547625 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.547752 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] resource.caching = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.547837 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.547966 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.548046 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.548143 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.548297 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] resource.caching = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.548379 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.548496 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.548583 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.548726 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.548869 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.548954 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.549102 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.549212 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.549346 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.549449 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.549561 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.549688 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.549819 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.549953 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.550160 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] role.caching = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.550244 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.550366 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] role.driver = sql {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.550444 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.550561 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.550640 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] role.caching = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.550765 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.550844 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] role.driver = sql {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.550960 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.551038 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.551240 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.551331 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.551462 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.551542 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.551693 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.551817 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.551943 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.552090 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.552219 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.552330 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.552409 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.552528 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.552614 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.552698 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.552835 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.552928 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.553079 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.553167 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.553326 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.553478 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.553568 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.553726 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.553860 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.553993 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.554081 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.554210 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.554443 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.554529 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.554680 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.554767 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.554921 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.555022 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.555167 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.555312 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.555422 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.555509 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.555674 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.555824 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.555941 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.556021 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.556153 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.556231 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.556348 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.556437 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.556554 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.556633 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.556774 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.556861 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.557024 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.557146 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.557268 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.557392 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.557520 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.557654 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.557790 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.557917 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.557996 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.558111 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.558225 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.558312 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.558438 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.558516 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] token.caching = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.558675 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.558762 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.558911 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] token.caching = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.558997 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.559146 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.559358 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.559466 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.559551 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.559680 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.559778 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.559913 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.559992 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.560121 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.560202 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.560319 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.560397 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.560566 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.560648 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.560765 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.560843 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.560997 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.561088 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.561242 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.561375 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.561510 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.561593 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.561712 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.561790 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.561901 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.562002 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.562101 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.562201 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.562396 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.562561 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.562714 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.562851 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] database.connection = **** {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.562851 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.563079 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.563157 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.563306 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] database.connection = **** {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.563404 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.563482 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.563550 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.563676 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.563780 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.563863 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.564013 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.564127 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.564243 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.564334 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.564455 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.564533 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.564697 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.564780 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.564926 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.565018 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.565164 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.565248 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.565395 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.565478 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.565638 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.565729 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.565870 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.565952 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.566107 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.566189 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.566340 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.566430 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.566573 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.566655 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.566802 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.566920 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.567027 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 03:59:32.567164 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.567386 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:59:32.567516 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 03:59:32.596904 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.597133 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.597358 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.597454 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.597606 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.597745 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.606084 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.606371 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.637197 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.637443 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.637443 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.637736 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.690812 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.691382 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.740199 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.740457 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.740869 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.741106 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.810035 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.810296 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.810492 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.810701 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.810823 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.810979 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.811094 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.811236 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.811365 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.811484 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.811605 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.811605 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.835215 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.835441 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.835577 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.835709 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.835865 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.835983 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.836114 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.836233 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.836355 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.836490 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.836607 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.836736 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.836857 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.836857 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.848340 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.848558 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.862131 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.862368 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.862368 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.862602 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.862774 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.862908 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.862908 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.863153 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.863326 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.863484 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.863617 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.863722 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.863825 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.863928 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:59:32.880534 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.880779 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 03:59:32.880963 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.881169 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.881313 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 03:59:32.881450 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 03:59:32.881619 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.881753 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.881753 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 03:59:32.882003 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.882132 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.882267 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.882377 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.882506 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.882626 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.882756 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.891876 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.892217 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.892372 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.892533 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.893098 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.893255 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.893415 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.893415 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.899704 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:59:32.900158 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:59:32.902694 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:59:32.902945 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.903151 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:59:32.903320 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.903467 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.903585 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.903755 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.903883 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.904035 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.904169 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.904287 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.904420 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.904564 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.904681 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.904834 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.904951 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.905102 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.905241 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.905353 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.905470 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.905640 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.905937 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.929973 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.930506 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.931553 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:59:32.931832 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.932052 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:59:32.932356 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.936433 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:59:32.936713 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.936981 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:59:32.937077 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.937269 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.937541 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.943704 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:59:32.943932 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.944165 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:59:32.944474 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.948637 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:59:32.948927 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.949088 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:59:32.949214 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.949396 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.949549 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.949669 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.949782 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.949957 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.950152 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.950277 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.950410 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.950648 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.950770 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.950925 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.951232 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.966788 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.967047 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.967291 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.967626 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.971267 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:59:32.971709 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:59:32.974623 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.974943 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.975095 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.975364 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.979470 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:59:32.979908 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:59:32.982749 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:59:32.983100 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:59:32.985892 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.986202 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.986391 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.986514 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.986643 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.986765 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.986837 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.986989 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.987126 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.987394 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.987545 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:32.987801 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.003553 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:59:33.003813 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.003937 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:59:33.004101 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.004224 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.004354 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.004539 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.004748 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.011374 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.011704 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.013130 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.013397 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.013574 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.013702 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.016111 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:59:33.016412 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:59:33.016596 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.016718 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.016841 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.017019 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.017131 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.017266 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.017381 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.017541 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.028910 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:59:33.029165 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:59:33.029342 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.029463 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.029600 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.029722 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.029846 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.029986 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.030105 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.030239 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.030368 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.030495 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.030630 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.030750 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.046383 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:59:33.046641 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:59:33.049337 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:59:33.049542 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:59:33.052437 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.052644 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.053876 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.054047 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.055487 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:59:33.055689 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:59:33.055813 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.055941 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.056064 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.056191 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.062648 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.062861 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.064192 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:59:33.064354 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:59:33.067068 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.067319 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.067505 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.067624 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.067748 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.067871 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.067992 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.068185 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.077626 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:59:33.077839 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:59:33.077992 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.078163 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.078336 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.078553 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.085081 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:59:33.085443 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:59:33.085581 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.085739 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.085863 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.086030 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.086119 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.086311 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.086403 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.086574 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.086666 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.086875 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.086968 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.087139 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.088895 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.089034 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.089167 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.089303 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.089504 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.089631 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.089751 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.089874 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.090060 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.090188 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.090332 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.090332 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.090332 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.090655 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:59:33.122364 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c2191e49c0 pid: 88432 (default app) Aug 24 03:59:33.123021 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c2191e49c0 pid: 88431 (default app) Aug 24 03:59:33.126155 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33270d0d-9ff3-4af3-b6ec-0cf443e96d24 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:33.126464 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33270d0d-9ff3-4af3-b6ec-0cf443e96d24 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:33.126705 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33270d0d-9ff3-4af3-b6ec-0cf443e96d24 None None] PATH_INFO: `/v3` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:33.130949 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 791 bytes} [Wed Aug 24 03:59:33 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:59:40.357445 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0c9fc-c9f7-4cb5-8d12-7973dfda2942 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:40.357983 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0c9fc-c9f7-4cb5-8d12-7973dfda2942 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:40.357983 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0c9fc-c9f7-4cb5-8d12-7973dfda2942 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:40.362385 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 1/2] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 03:59:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:59:40.369536 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064682b-fe71-4c9d-ab0d-87eb1fd62f88 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:40.370178 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064682b-fe71-4c9d-ab0d-87eb1fd62f88 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:40.370505 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064682b-fe71-4c9d-ab0d-87eb1fd62f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:40.457556 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: INFO dbcounter [None req-8064682b-fe71-4c9d-ab0d-87eb1fd62f88 None None] Registered counter for database keystone Aug 24 03:59:40.477210 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG oslo_db.sqlalchemy.engines [None req-8064682b-fe71-4c9d-ab0d-87eb1fd62f88 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88432) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:59:40.484354 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writer thread running {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:59:40.667941 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG passlib.handlers.bcrypt [None req-8064682b-fe71-4c9d-ab0d-87eb1fd62f88 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88432) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 03:59:40.668276 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG passlib.handlers.bcrypt [None req-8064682b-fe71-4c9d-ab0d-87eb1fd62f88 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88432) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 03:59:40.724428 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-8064682b-fe71-4c9d-ab0d-87eb1fd62f88 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:59:40.726087 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-8064682b-fe71-4c9d-ab0d-87eb1fd62f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:40.874279 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 2/3] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 03:59:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 507 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 03:59:41.403096 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0c9fc-c9f7-4cb5-8d12-7973dfda2942 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:41.479317 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: INFO dbcounter [None req-f9d0c9fc-c9f7-4cb5-8d12-7973dfda2942 None None] Registered counter for database keystone Aug 24 03:59:41.501661 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG oslo_db.sqlalchemy.engines [None req-f9d0c9fc-c9f7-4cb5-8d12-7973dfda2942 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88431) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:59:41.510119 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writer thread running {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:59:41.631489 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0c9fc-c9f7-4cb5-8d12-7973dfda2942 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:41.636590 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c39ea86-cafa-4c42-aeaa-705927474ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d781cc0590648468fbe68aed993b0f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:41.637245 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39ea86-cafa-4c42-aeaa-705927474ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:41.637522 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39ea86-cafa-4c42-aeaa-705927474ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:41.637791 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39ea86-cafa-4c42-aeaa-705927474ec4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:41.647182 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c39ea86-cafa-4c42-aeaa-705927474ec4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:41.700776 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1c39ea86-cafa-4c42-aeaa-705927474ec4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 03:59:41.701027 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c39ea86-cafa-4c42-aeaa-705927474ec4 admin admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:41.712288 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 2/4] 10.222.0.15 () {58 vars in 1324 bytes} [Wed Aug 24 03:59:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 03:59:41.718722 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8064682b-fe71-4c9d-ab0d-87eb1fd62f88 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:41.737096 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8064682b-fe71-4c9d-ab0d-87eb1fd62f88 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:41.743066 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4897bc9-726f-4fe5-bcb5-2991f805aa6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d781cc0590648468fbe68aed993b0f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:41.744328 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4897bc9-726f-4fe5-bcb5-2991f805aa6a admin admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:41.744608 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4897bc9-726f-4fe5-bcb5-2991f805aa6a admin admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:41.744931 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4897bc9-726f-4fe5-bcb5-2991f805aa6a admin admin] PATH_INFO: `/v3/projects/3d781cc0590648468fbe68aed993b0f3` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:41.746556 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4897bc9-726f-4fe5-bcb5-2991f805aa6a admin admin] RBAC: Authorizing `identity:get_project(project_id=3d781cc0590648468fbe68aed993b0f3)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:41.797121 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f4897bc9-726f-4fe5-bcb5-2991f805aa6a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 03:59:41.797458 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4897bc9-726f-4fe5-bcb5-2991f805aa6a admin admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:41.802281 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 3/5] 10.222.0.15 () {56 vars in 1207 bytes} [Wed Aug 24 03:59:41 2022] GET /identity/v3/projects/3d781cc0590648468fbe68aed993b0f3 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:59:43.977732 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f2c84-436a-47e9-98b0-5bb077510bd7 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:43.978305 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f2c84-436a-47e9-98b0-5bb077510bd7 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:43.978305 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f2c84-436a-47e9-98b0-5bb077510bd7 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:43.982834 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 3/6] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 03:59:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:59:43.988920 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e87df-c24c-4dd2-9eeb-64802434bf5f None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:43.989582 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e87df-c24c-4dd2-9eeb-64802434bf5f None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:43.989582 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e87df-c24c-4dd2-9eeb-64802434bf5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:44.010238 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-3d5e87df-c24c-4dd2-9eeb-64802434bf5f None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:59:44.011857 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-3d5e87df-c24c-4dd2-9eeb-64802434bf5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:44.020029 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 4/7] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 03:59:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 03:59:44.340858 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f2c84-436a-47e9-98b0-5bb077510bd7 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:44.354886 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f2c84-436a-47e9-98b0-5bb077510bd7 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:44.359598 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09ee144-0f37-46a5-8b78-59749fe0c9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d781cc0590648468fbe68aed993b0f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:44.360209 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ee144-0f37-46a5-8b78-59749fe0c9f2 admin admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:44.360490 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ee144-0f37-46a5-8b78-59749fe0c9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:44.360758 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ee144-0f37-46a5-8b78-59749fe0c9f2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:44.369382 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09ee144-0f37-46a5-8b78-59749fe0c9f2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:44.371249 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09ee144-0f37-46a5-8b78-59749fe0c9f2 admin admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:44.380699 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 4/8] 10.222.0.15 () {58 vars in 1324 bytes} [Wed Aug 24 03:59:44 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:59:44.386725 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e87df-c24c-4dd2-9eeb-64802434bf5f None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:44.396773 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e87df-c24c-4dd2-9eeb-64802434bf5f None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:44.402234 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c328f-e3ab-45de-a4db-f0e0bc7cf32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d781cc0590648468fbe68aed993b0f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:44.402874 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c328f-e3ab-45de-a4db-f0e0bc7cf32a admin admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:44.403149 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c328f-e3ab-45de-a4db-f0e0bc7cf32a admin admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:44.403450 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c328f-e3ab-45de-a4db-f0e0bc7cf32a admin admin] PATH_INFO: `/v3/users/c414fa8ffb744c22a2619f1ccb5b8577` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:44.404865 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480c328f-e3ab-45de-a4db-f0e0bc7cf32a admin admin] RBAC: Authorizing `identity:get_user(user_id=c414fa8ffb744c22a2619f1ccb5b8577)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:44.406725 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480c328f-e3ab-45de-a4db-f0e0bc7cf32a admin admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:44.408325 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 5/9] 10.222.0.15 () {56 vars in 1198 bytes} [Wed Aug 24 03:59:44 2022] GET /identity/v3/users/c414fa8ffb744c22a2619f1ccb5b8577 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:59:46.690586 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131bd9a-2ee4-4074-bd46-36d370acab60 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:46.691153 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131bd9a-2ee4-4074-bd46-36d370acab60 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:46.691153 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131bd9a-2ee4-4074-bd46-36d370acab60 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:46.692548 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 5/10] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 03:59:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:59:46.699123 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5f1be-e7c2-444e-9f68-232d02f70f36 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:46.699633 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5f1be-e7c2-444e-9f68-232d02f70f36 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:46.699732 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5f1be-e7c2-444e-9f68-232d02f70f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:46.722039 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-7fe5f1be-e7c2-444e-9f68-232d02f70f36 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:59:46.723282 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-7fe5f1be-e7c2-444e-9f68-232d02f70f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:46.742008 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e128c1-89f1-40d4-ba99-96d18352017a None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:46.742244 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e128c1-89f1-40d4-ba99-96d18352017a None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:46.742530 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e128c1-89f1-40d4-ba99-96d18352017a None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:46.743904 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 6/11] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 03:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:59:46.749724 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e650c0-db3d-4425-836a-29b8b7664ba3 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:46.749993 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e650c0-db3d-4425-836a-29b8b7664ba3 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:46.750476 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e650c0-db3d-4425-836a-29b8b7664ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:46.795170 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG passlib.handlers.bcrypt [None req-80e650c0-db3d-4425-836a-29b8b7664ba3 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88431) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 03:59:46.795729 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG passlib.handlers.bcrypt [None req-80e650c0-db3d-4425-836a-29b8b7664ba3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88431) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 03:59:46.842732 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-80e650c0-db3d-4425-836a-29b8b7664ba3 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:59:46.844450 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-80e650c0-db3d-4425-836a-29b8b7664ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:46.943135 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 6/12] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 03:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:59:46.966198 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 7/13] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 03:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:59:47.261910 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5f1be-e7c2-444e-9f68-232d02f70f36 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:47.282170 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e650c0-db3d-4425-836a-29b8b7664ba3 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:47.287397 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:47.385268 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5f1be-e7c2-444e-9f68-232d02f70f36 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:47.394842 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e650c0-db3d-4425-836a-29b8b7664ba3 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:47.397329 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:47.422875 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5a933-c5fa-40db-8fad-86692e86f502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:47.423585 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5a933-c5fa-40db-8fad-86692e86f502 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:47.423873 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5a933-c5fa-40db-8fad-86692e86f502 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:47.424149 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5a933-c5fa-40db-8fad-86692e86f502 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:47.435414 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce6c87-8a79-4922-acd8-a1e3c7081ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:47.436277 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce6c87-8a79-4922-acd8-a1e3c7081ae5 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:47.436554 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce6c87-8a79-4922-acd8-a1e3c7081ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:47.436657 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d5a933-c5fa-40db-8fad-86692e86f502 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:59:47.436829 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce6c87-8a79-4922-acd8-a1e3c7081ae5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:47.445321 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-a3d5a933-c5fa-40db-8fad-86692e86f502 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:59:47.445321 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:59:47.445321 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:59:47.445321 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:59:47.445321 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:59:47.445321 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:59:47.445321 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:59:47.445321 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:59:47.445321 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:59:47.445321 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:59:47.445321 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:59:47.445321 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:59:47.445321 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:59:47.445321 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:59:47.445321 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:59:47.445321 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:59:47.446531 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:59:47.446531 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:59:47.446531 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:59:47.446531 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:59:47.446531 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:59:47.446531 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:59:47.446531 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:59:47.446531 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:59:47.446531 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:59:47.446531 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:59:47.446531 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:59:47.446531 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 03:59:47.446531 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:59:47.446531 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:59:47.446531 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:59:47.446531 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:59:47.447505 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:59:47.447505 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:59:47.447505 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:59:47.447505 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:59:47.447505 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:59:47.447505 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:59:47.447505 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:59:47.447505 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:59:47.447505 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:59:47.447505 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:59:47.447505 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:59:47.447505 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 03:59:47.447505 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 7/14] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 24 03:59:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:59:47.454164 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5a933-c5fa-40db-8fad-86692e86f502 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:47.515650 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce6c87-8a79-4922-acd8-a1e3c7081ae5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:47.518420 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce6c87-8a79-4922-acd8-a1e3c7081ae5 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:47.540520 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:47.559453 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5a933-c5fa-40db-8fad-86692e86f502 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:47.596447 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52efc6d4-d35f-48d0-9df6-c903a2d2602f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:47.597059 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efc6d4-d35f-48d0-9df6-c903a2d2602f None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:47.597381 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efc6d4-d35f-48d0-9df6-c903a2d2602f None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:47.597653 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efc6d4-d35f-48d0-9df6-c903a2d2602f None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:47.598310 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52efc6d4-d35f-48d0-9df6-c903a2d2602f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:59:47.598614 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52efc6d4-d35f-48d0-9df6-c903a2d2602f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:47.600060 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52efc6d4-d35f-48d0-9df6-c903a2d2602f None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:47.612616 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 8/15] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 03:59:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:59:47.618221 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52efc6d4-d35f-48d0-9df6-c903a2d2602f None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:47.675779 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 8/16] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 24 03:59:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 03:59:47.681585 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce6c87-8a79-4922-acd8-a1e3c7081ae5 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:47.684527 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:47.738129 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52efc6d4-d35f-48d0-9df6-c903a2d2602f None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:47.781552 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78d97c-a62b-4268-91aa-b70e75ca3629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:47.782181 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78d97c-a62b-4268-91aa-b70e75ca3629 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:47.782464 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78d97c-a62b-4268-91aa-b70e75ca3629 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:47.782733 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e78d97c-a62b-4268-91aa-b70e75ca3629 None admin] PATH_INFO: `/v3/users/c414fa8ffb744c22a2619f1ccb5b8577` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:47.784027 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e78d97c-a62b-4268-91aa-b70e75ca3629 None admin] RBAC: Authorizing `identity:get_user(user_id=c414fa8ffb744c22a2619f1ccb5b8577)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:47.785537 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e78d97c-a62b-4268-91aa-b70e75ca3629 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:47.787520 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 9/17] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 24 03:59:47 2022] GET /identity/v3/users/c414fa8ffb744c22a2619f1ccb5b8577 => generated 247 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:59:47.791154 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce6c87-8a79-4922-acd8-a1e3c7081ae5 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:47.793212 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78d97c-a62b-4268-91aa-b70e75ca3629 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:47.809293 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:47.830813 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f21fb-1157-490f-b83a-6c9af7341fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:47.831737 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f21fb-1157-490f-b83a-6c9af7341fbc None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:47.832021 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f21fb-1157-490f-b83a-6c9af7341fbc None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:47.832293 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f21fb-1157-490f-b83a-6c9af7341fbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:47.854595 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f21fb-1157-490f-b83a-6c9af7341fbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:47.856176 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f21fb-1157-490f-b83a-6c9af7341fbc None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:47.875162 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-a81f21fb-1157-490f-b83a-6c9af7341fbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:59:47.875162 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:59:47.875162 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:59:47.875162 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:59:47.875162 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:59:47.875162 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:59:47.875162 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:59:47.875162 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:59:47.875162 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:59:47.875162 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:59:47.875162 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:59:47.875162 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:59:47.875162 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:59:47.875162 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:59:47.875162 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:59:47.875162 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:59:47.876249 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:59:47.876249 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:59:47.876249 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:59:47.876249 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:59:47.876249 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:59:47.876249 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:59:47.876249 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:59:47.876249 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 03:59:47.876249 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:59:47.876249 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:59:47.876249 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:59:47.876249 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:59:47.876249 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:59:47.876249 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:59:47.876249 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:59:47.876249 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:59:47.876249 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:59:47.877241 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:59:47.877241 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:59:47.877241 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 03:59:47.877241 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 9/18] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 03:59:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:59:47.909977 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e78d97c-a62b-4268-91aa-b70e75ca3629 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:47.956085 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e91282-4b9c-446b-b02f-8b06e27056d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:47.957172 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e91282-4b9c-446b-b02f-8b06e27056d1 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:47.957648 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e91282-4b9c-446b-b02f-8b06e27056d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:47.957931 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e91282-4b9c-446b-b02f-8b06e27056d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:47.959480 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e91282-4b9c-446b-b02f-8b06e27056d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:47.960968 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e91282-4b9c-446b-b02f-8b06e27056d1 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:47.962656 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 10/19] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 03:59:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:59:47.971487 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e91282-4b9c-446b-b02f-8b06e27056d1 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:47.994091 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f21fb-1157-490f-b83a-6c9af7341fbc None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:48.056401 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:48.058077 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:48.077698 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e91282-4b9c-446b-b02f-8b06e27056d1 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:48.104537 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f21fb-1157-490f-b83a-6c9af7341fbc None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:48.113091 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145aa0a0-1915-4691-adaf-07947b833d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:48.113710 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145aa0a0-1915-4691-adaf-07947b833d00 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:48.113989 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145aa0a0-1915-4691-adaf-07947b833d00 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:48.114266 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145aa0a0-1915-4691-adaf-07947b833d00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:48.114996 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145aa0a0-1915-4691-adaf-07947b833d00 None admin] RBAC: Adding query filter params (role.id=df6a8bb215d54f71a0b6988a9c01f5e4, scope.domain.id=default, user.id=c414fa8ffb744c22a2619f1ccb5b8577) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:59:48.115339 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145aa0a0-1915-4691-adaf-07947b833d00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:48.116801 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145aa0a0-1915-4691-adaf-07947b833d00 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:48.123884 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 11/20] 10.222.0.15 () {56 vars in 1322 bytes} [Wed Aug 24 03:59:47 2022] GET /identity/v3/role_assignments?user.id=c414fa8ffb744c22a2619f1ccb5b8577&scope.domain.id=default&role.id=df6a8bb215d54f71a0b6988a9c01f5e4 => generated 233 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:59:48.141578 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f989e-7b72-4e30-9a0c-43f8a06802d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:48.142216 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f989e-7b72-4e30-9a0c-43f8a06802d4 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:48.142499 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f989e-7b72-4e30-9a0c-43f8a06802d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:48.142774 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f989e-7b72-4e30-9a0c-43f8a06802d4 None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:48.143482 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f989e-7b72-4e30-9a0c-43f8a06802d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:59:48.143786 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f989e-7b72-4e30-9a0c-43f8a06802d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:48.145241 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f989e-7b72-4e30-9a0c-43f8a06802d4 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:48.165841 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 10/21] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 03:59:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:59:50.538169 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec683de-0f59-4776-8441-f54efeda117d None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:50.539226 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec683de-0f59-4776-8441-f54efeda117d None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:50.539796 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec683de-0f59-4776-8441-f54efeda117d None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:50.541907 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 12/22] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 03:59:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:59:50.550770 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07332ca7-0f00-4837-9631-73485d869212 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:50.551701 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07332ca7-0f00-4837-9631-73485d869212 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:50.552208 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07332ca7-0f00-4837-9631-73485d869212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:50.588326 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-07332ca7-0f00-4837-9631-73485d869212 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:59:50.589922 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-07332ca7-0f00-4837-9631-73485d869212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:50.685929 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 11/23] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 03:59:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:59:50.901338 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de563673-d017-403c-b1a5-648975b6525d None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:50.901653 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de563673-d017-403c-b1a5-648975b6525d None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:50.902172 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de563673-d017-403c-b1a5-648975b6525d None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:50.903737 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 13/24] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 03:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:59:50.909822 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967de950-c530-4834-82e8-6079d0e42252 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:50.910385 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967de950-c530-4834-82e8-6079d0e42252 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:50.910890 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967de950-c530-4834-82e8-6079d0e42252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:50.939725 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-967de950-c530-4834-82e8-6079d0e42252 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:59:50.941039 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-967de950-c530-4834-82e8-6079d0e42252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:51.003126 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:51.044949 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 12/25] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 03:59:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:59:51.189580 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b230af-1d36-469e-8503-64f33b1c57b5 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:51.189876 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b230af-1d36-469e-8503-64f33b1c57b5 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:51.190082 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b230af-1d36-469e-8503-64f33b1c57b5 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:51.191517 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 14/26] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 03:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:59:51.194404 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9c5a7-bcf4-4c96-8e1b-f447a71f1e93 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:51.194696 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9c5a7-bcf4-4c96-8e1b-f447a71f1e93 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:51.194974 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9c5a7-bcf4-4c96-8e1b-f447a71f1e93 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:51.197141 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 13/27] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 03:59:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:59:51.201600 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce30692-eb47-49d9-bde8-929d38e2a834 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:51.201891 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce30692-eb47-49d9-bde8-929d38e2a834 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:51.202182 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce30692-eb47-49d9-bde8-929d38e2a834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:51.210575 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7f016-d1d0-4658-a69f-c90093002c44 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:51.210881 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7f016-d1d0-4658-a69f-c90093002c44 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:51.211158 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7f016-d1d0-4658-a69f-c90093002c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:51.237457 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-3ce30692-eb47-49d9-bde8-929d38e2a834 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:59:51.238692 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-3ce30692-eb47-49d9-bde8-929d38e2a834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:51.269825 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-41c7f016-d1d0-4658-a69f-c90093002c44 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:59:51.271049 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-41c7f016-d1d0-4658-a69f-c90093002c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:51.384256 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 15/28] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 03:59:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:59:51.386253 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce30692-eb47-49d9-bde8-929d38e2a834 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:51.399346 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 14/29] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 03:59:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:59:51.474662 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:51.500250 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce30692-eb47-49d9-bde8-929d38e2a834 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:51.535924 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc340fb7-8260-4a59-a666-1ae38aa54ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:51.536666 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc340fb7-8260-4a59-a666-1ae38aa54ce2 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:51.536945 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc340fb7-8260-4a59-a666-1ae38aa54ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:51.537214 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc340fb7-8260-4a59-a666-1ae38aa54ce2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:51.548410 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc340fb7-8260-4a59-a666-1ae38aa54ce2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:59:51.553266 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-fc340fb7-8260-4a59-a666-1ae38aa54ce2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:59:51.553266 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:59:51.553266 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:59:51.553266 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:59:51.553266 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:59:51.553266 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:59:51.553266 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:59:51.553266 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:59:51.553266 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:59:51.553266 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:59:51.553266 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:59:51.553266 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:59:51.553266 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:59:51.553266 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:59:51.553266 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:59:51.553266 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:59:51.554102 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:59:51.554102 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:59:51.554102 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:59:51.554102 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:59:51.554102 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:59:51.554102 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:59:51.554102 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:59:51.554102 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:59:51.554102 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:59:51.554102 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:59:51.554102 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:59:51.554102 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 03:59:51.554102 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:59:51.554102 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:59:51.554102 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:59:51.554102 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:59:51.554838 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:59:51.554838 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:59:51.554838 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:59:51.554838 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:59:51.554838 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:59:51.554838 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:59:51.554838 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:59:51.554838 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:59:51.554838 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:59:51.554838 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:59:51.554838 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:59:51.554838 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 03:59:51.554838 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 16/30] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 24 03:59:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:59:51.560727 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7f016-d1d0-4658-a69f-c90093002c44 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:51.648165 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc340fb7-8260-4a59-a666-1ae38aa54ce2 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:51.736119 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7f016-d1d0-4658-a69f-c90093002c44 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:51.748976 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:51.801026 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a80a7d-32d6-4c7c-ac88-89fe98b826a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:51.801645 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a80a7d-32d6-4c7c-ac88-89fe98b826a0 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:51.801922 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a80a7d-32d6-4c7c-ac88-89fe98b826a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:51.802248 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a80a7d-32d6-4c7c-ac88-89fe98b826a0 None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:51.803336 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a80a7d-32d6-4c7c-ac88-89fe98b826a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:59:51.803646 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a80a7d-32d6-4c7c-ac88-89fe98b826a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:51.805050 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a80a7d-32d6-4c7c-ac88-89fe98b826a0 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:51.819666 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 15/31] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 03:59:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:59:51.832417 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a80a7d-32d6-4c7c-ac88-89fe98b826a0 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:51.834487 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc340fb7-8260-4a59-a666-1ae38aa54ce2 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:51.878333 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b4353-ce18-4c52-ba71-5597c75a5266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:51.878975 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b4353-ce18-4c52-ba71-5597c75a5266 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:51.879282 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b4353-ce18-4c52-ba71-5597c75a5266 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:51.879561 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b4353-ce18-4c52-ba71-5597c75a5266 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:51.884799 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:51.901271 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b4353-ce18-4c52-ba71-5597c75a5266 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:51.902736 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b4353-ce18-4c52-ba71-5597c75a5266 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:51.933466 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-001b4353-ce18-4c52-ba71-5597c75a5266 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:59:51.933466 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:59:51.933466 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:59:51.933466 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:59:51.933466 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:59:51.933466 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:59:51.933466 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:59:51.933466 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:59:51.933466 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:59:51.933466 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:59:51.933466 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:59:51.933466 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:59:51.933466 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:59:51.933466 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:59:51.933466 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:59:51.933466 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:59:51.934342 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:59:51.934342 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:59:51.934342 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:59:51.934342 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:59:51.934342 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:59:51.934342 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:59:51.934342 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:59:51.934342 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 03:59:51.934342 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:59:51.934342 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:59:51.934342 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:59:51.934342 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:59:51.934342 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:59:51.934342 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:59:51.934342 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:59:51.934342 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:59:51.934342 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:59:51.935123 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:59:51.935123 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:59:51.935123 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 03:59:51.935123 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 17/32] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 03:59:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:59:51.948337 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b4353-ce18-4c52-ba71-5597c75a5266 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:51.980761 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a80a7d-32d6-4c7c-ac88-89fe98b826a0 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:52.051073 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48813ad5-3e9e-4ee8-973d-46082628704b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:52.051443 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48813ad5-3e9e-4ee8-973d-46082628704b None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:52.051532 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48813ad5-3e9e-4ee8-973d-46082628704b None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:52.051785 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48813ad5-3e9e-4ee8-973d-46082628704b None admin] PATH_INFO: `/v3/users/c414fa8ffb744c22a2619f1ccb5b8577` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:52.059301 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48813ad5-3e9e-4ee8-973d-46082628704b None admin] RBAC: Authorizing `identity:get_user(user_id=c414fa8ffb744c22a2619f1ccb5b8577)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:52.060917 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48813ad5-3e9e-4ee8-973d-46082628704b None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:52.062693 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 16/33] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 24 03:59:51 2022] GET /identity/v3/users/c414fa8ffb744c22a2619f1ccb5b8577 => generated 247 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:59:52.063505 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48813ad5-3e9e-4ee8-973d-46082628704b None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:52.090887 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b4353-ce18-4c52-ba71-5597c75a5266 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:52.127767 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e6d74-305a-4c2f-ac35-0f82ebf1ca06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:52.128769 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e6d74-305a-4c2f-ac35-0f82ebf1ca06 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:52.129235 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e6d74-305a-4c2f-ac35-0f82ebf1ca06 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:52.129690 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e6d74-305a-4c2f-ac35-0f82ebf1ca06 None admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:52.130521 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e6d74-305a-4c2f-ac35-0f82ebf1ca06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:59:52.131020 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e6d74-305a-4c2f-ac35-0f82ebf1ca06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:52.132614 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:52.132845 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e6d74-305a-4c2f-ac35-0f82ebf1ca06 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:52.151733 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 18/34] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 03:59:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:59:52.152982 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e6d74-305a-4c2f-ac35-0f82ebf1ca06 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:52.205948 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:52.226117 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48813ad5-3e9e-4ee8-973d-46082628704b None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:52.262752 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e6d74-305a-4c2f-ac35-0f82ebf1ca06 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:52.263696 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50298a53-c94c-4bfe-a8a4-2574d731b4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:52.264470 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50298a53-c94c-4bfe-a8a4-2574d731b4fa None admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:52.264890 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50298a53-c94c-4bfe-a8a4-2574d731b4fa None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:52.265244 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50298a53-c94c-4bfe-a8a4-2574d731b4fa None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:52.266669 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50298a53-c94c-4bfe-a8a4-2574d731b4fa None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:52.267567 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50298a53-c94c-4bfe-a8a4-2574d731b4fa None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:52.304160 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f537fa7-c651-4ac2-9a0d-dd29597f2e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:52.305068 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f537fa7-c651-4ac2-9a0d-dd29597f2e27 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:52.305493 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f537fa7-c651-4ac2-9a0d-dd29597f2e27 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:52.305899 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f537fa7-c651-4ac2-9a0d-dd29597f2e27 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:52.307401 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f537fa7-c651-4ac2-9a0d-dd29597f2e27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:52.309038 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f537fa7-c651-4ac2-9a0d-dd29597f2e27 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:52.311247 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 19/35] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 03:59:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:59:52.312288 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f537fa7-c651-4ac2-9a0d-dd29597f2e27 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:52.416240 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f537fa7-c651-4ac2-9a0d-dd29597f2e27 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:52.429939 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 17/36] 10.222.0.15 () {60 vars in 1131 bytes} [Wed Aug 24 03:59:52 2022] POST /identity/v3/roles => generated 219 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:59:52.431487 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50298a53-c94c-4bfe-a8a4-2574d731b4fa None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:52.449417 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:52.474112 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ff8d5-b83d-44b3-b899-c6ed7cf7e49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:52.475231 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ff8d5-b83d-44b3-b899-c6ed7cf7e49c None admin] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:52.475704 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ff8d5-b83d-44b3-b899-c6ed7cf7e49c None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:52.476210 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ff8d5-b83d-44b3-b899-c6ed7cf7e49c None admin] PATH_INFO: `/v3/projects` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:52.477089 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ff8d5-b83d-44b3-b899-c6ed7cf7e49c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:52.479093 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ff8d5-b83d-44b3-b899-c6ed7cf7e49c None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:52.569844 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:52.578090 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50298a53-c94c-4bfe-a8a4-2574d731b4fa None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:52.618242 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53ccb3-76d9-4ff7-acf9-0542d0dce0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:52.618878 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53ccb3-76d9-4ff7-acf9-0542d0dce0bd None admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:52.619170 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53ccb3-76d9-4ff7-acf9-0542d0dce0bd None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:52.619671 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53ccb3-76d9-4ff7-acf9-0542d0dce0bd None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:52.620285 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc53ccb3-76d9-4ff7-acf9-0542d0dce0bd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:52.621889 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc53ccb3-76d9-4ff7-acf9-0542d0dce0bd None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:52.638443 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 18/37] 10.222.0.15 () {60 vars in 1131 bytes} [Wed Aug 24 03:59:52 2022] POST /identity/v3/roles => generated 225 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:59:52.638845 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 20/38] 10.222.0.15 () {60 vars in 1141 bytes} [Wed Aug 24 03:59:52 2022] POST /identity/v3/projects => generated 301 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:59:52.640470 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616ba35-0c12-4682-bf90-60f33587d624 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:52.640766 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616ba35-0c12-4682-bf90-60f33587d624 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:52.641041 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616ba35-0c12-4682-bf90-60f33587d624 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:52.642544 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 21/39] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 03:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:59:52.651408 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9f488-6748-4f6f-baac-e7fc89c1633d None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:52.651408 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9f488-6748-4f6f-baac-e7fc89c1633d None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:52.651408 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9f488-6748-4f6f-baac-e7fc89c1633d None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:52.651731 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53ccb3-76d9-4ff7-acf9-0542d0dce0bd None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:52.651801 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 22/40] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 03:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:59:52.651801 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2627357-7494-4805-ab1e-3f85d6bf0072 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:52.651801 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2627357-7494-4805-ab1e-3f85d6bf0072 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:52.652078 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2627357-7494-4805-ab1e-3f85d6bf0072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:52.679426 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-d2627357-7494-4805-ab1e-3f85d6bf0072 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:59:52.682709 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-d2627357-7494-4805-ab1e-3f85d6bf0072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:52.787215 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 23/41] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 03:59:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:59:52.788925 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a54082-cc63-4d77-976a-28ccb02d21bc None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:52.789505 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a54082-cc63-4d77-976a-28ccb02d21bc None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:52.790077 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a54082-cc63-4d77-976a-28ccb02d21bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:52.814752 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53ccb3-76d9-4ff7-acf9-0542d0dce0bd None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:52.824434 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-19a54082-cc63-4d77-976a-28ccb02d21bc None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:59:52.826064 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-19a54082-cc63-4d77-976a-28ccb02d21bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:52.866252 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71730a-470d-4850-9d81-a50e196b2d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:52.867206 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71730a-470d-4850-9d81-a50e196b2d22 None admin] REQUEST_METHOD: `PUT` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:52.867663 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71730a-470d-4850-9d81-a50e196b2d22 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:52.867955 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71730a-470d-4850-9d81-a50e196b2d22 None admin] PATH_INFO: `/v3/domains/default/users/c414fa8ffb744c22a2619f1ccb5b8577/roles/df6a8bb215d54f71a0b6988a9c01f5e4` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:52.870454 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71730a-470d-4850-9d81-a50e196b2d22 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=c414fa8ffb744c22a2619f1ccb5b8577, role_id=df6a8bb215d54f71a0b6988a9c01f5e4)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:52.872729 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71730a-470d-4850-9d81-a50e196b2d22 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:52.893506 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 19/42] 10.222.0.15 () {58 vars in 1361 bytes} [Wed Aug 24 03:59:52 2022] PUT /identity/v3/domains/default/users/c414fa8ffb744c22a2619f1ccb5b8577/roles/df6a8bb215d54f71a0b6988a9c01f5e4 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:59:52.972266 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 24/43] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 03:59:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:59:53.150197 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71730a-470d-4850-9d81-a50e196b2d22 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:53.171183 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:53.259180 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71730a-470d-4850-9d81-a50e196b2d22 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:53.295025 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac173c-cf42-4b3b-aff0-8d58277ef844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:53.295682 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac173c-cf42-4b3b-aff0-8d58277ef844 None admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:53.295966 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac173c-cf42-4b3b-aff0-8d58277ef844 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:53.296241 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac173c-cf42-4b3b-aff0-8d58277ef844 None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:53.296913 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac173c-cf42-4b3b-aff0-8d58277ef844 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:53.298646 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac173c-cf42-4b3b-aff0-8d58277ef844 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:53.299342 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a54082-cc63-4d77-976a-28ccb02d21bc None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:53.316259 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 20/44] 10.222.0.15 () {60 vars in 1131 bytes} [Wed Aug 24 03:59:53 2022] POST /identity/v3/roles => generated 223 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:59:53.339180 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:53.434227 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a54082-cc63-4d77-976a-28ccb02d21bc None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:53.483563 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d2f14-3c4f-4c1b-88e4-84480ad9edf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:53.484429 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d2f14-3c4f-4c1b-88e4-84480ad9edf3 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:53.484885 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d2f14-3c4f-4c1b-88e4-84480ad9edf3 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:53.485325 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d2f14-3c4f-4c1b-88e4-84480ad9edf3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:53.487204 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d2f14-3c4f-4c1b-88e4-84480ad9edf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:53.489081 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d2f14-3c4f-4c1b-88e4-84480ad9edf3 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:53.491019 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 25/45] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 03:59:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:59:53.496569 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac173c-cf42-4b3b-aff0-8d58277ef844 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:53.594870 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:53.618188 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac173c-cf42-4b3b-aff0-8d58277ef844 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:53.653344 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da1ead-fb37-43fd-af44-9f8bf3592e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:53.653951 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da1ead-fb37-43fd-af44-9f8bf3592e9e None admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:53.654227 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da1ead-fb37-43fd-af44-9f8bf3592e9e None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:53.654486 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da1ead-fb37-43fd-af44-9f8bf3592e9e None admin] PATH_INFO: `/v3/projects` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:53.655145 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da1ead-fb37-43fd-af44-9f8bf3592e9e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:53.656628 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da1ead-fb37-43fd-af44-9f8bf3592e9e None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:53.687583 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 21/46] 10.222.0.15 () {60 vars in 1141 bytes} [Wed Aug 24 03:59:53 2022] POST /identity/v3/projects => generated 312 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:59:55.117258 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab68df-b55b-4c88-bd2c-60b69b2c256a None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:55.117797 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab68df-b55b-4c88-bd2c-60b69b2c256a None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:55.117797 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab68df-b55b-4c88-bd2c-60b69b2c256a None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:55.119128 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 26/47] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 03:59:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:59:55.125025 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde5006-1405-419d-9282-5cbb6851b530 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:55.125450 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde5006-1405-419d-9282-5cbb6851b530 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:55.125592 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde5006-1405-419d-9282-5cbb6851b530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:55.144684 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-3fde5006-1405-419d-9282-5cbb6851b530 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:59:55.146247 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-3fde5006-1405-419d-9282-5cbb6851b530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:55.216505 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 22/48] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 03:59:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:59:55.534841 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab68df-b55b-4c88-bd2c-60b69b2c256a None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:55.634460 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:55.643762 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab68df-b55b-4c88-bd2c-60b69b2c256a None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:55.679782 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1994b932-8b75-425c-b783-bbd2946ec816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:55.680444 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994b932-8b75-425c-b783-bbd2946ec816 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:55.680724 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994b932-8b75-425c-b783-bbd2946ec816 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:55.680997 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994b932-8b75-425c-b783-bbd2946ec816 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:55.694415 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1994b932-8b75-425c-b783-bbd2946ec816 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:59:55.699827 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-1994b932-8b75-425c-b783-bbd2946ec816 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:59:55.699827 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:59:55.699827 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:59:55.699827 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:59:55.699827 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:59:55.699827 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:59:55.699827 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:59:55.699827 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:59:55.699827 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:59:55.699827 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:59:55.699827 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:59:55.699827 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:59:55.699827 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:59:55.699827 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:59:55.699827 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:59:55.699827 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:59:55.700786 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:59:55.700786 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:59:55.700786 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:59:55.700786 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:59:55.700786 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:59:55.700786 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:59:55.700786 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:59:55.700786 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:59:55.700786 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:59:55.700786 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:59:55.700786 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:59:55.700786 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 03:59:55.700786 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:59:55.700786 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:59:55.700786 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:59:55.700786 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:59:55.701560 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:59:55.701560 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:59:55.701560 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:59:55.701560 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:59:55.701560 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:59:55.701560 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:59:55.701560 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:59:55.701560 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:59:55.701560 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:59:55.701560 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:59:55.701560 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:59:55.701560 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 03:59:55.701560 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 27/49] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 24 03:59:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:59:55.707511 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde5006-1405-419d-9282-5cbb6851b530 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:55.770200 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:55.817109 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde5006-1405-419d-9282-5cbb6851b530 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:55.851993 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f61b68-267b-4fc0-aaec-6e622dee4937 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:55.852257 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f61b68-267b-4fc0-aaec-6e622dee4937 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:55.852566 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f61b68-267b-4fc0-aaec-6e622dee4937 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:55.853016 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fcdf7e-d91a-4b52-8272-430c1c1a63af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:55.853664 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fcdf7e-d91a-4b52-8272-430c1c1a63af None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:55.853922 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 28/50] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 03:59:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:59:55.854023 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fcdf7e-d91a-4b52-8272-430c1c1a63af None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:55.854272 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fcdf7e-d91a-4b52-8272-430c1c1a63af None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:55.855015 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fcdf7e-d91a-4b52-8272-430c1c1a63af None admin] RBAC: Adding query filter params (name=admin) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:59:55.855356 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fcdf7e-d91a-4b52-8272-430c1c1a63af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:55.856759 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fcdf7e-d91a-4b52-8272-430c1c1a63af None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:55.859031 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72340bf7-74d0-41cd-b06f-ec7e0c02541b None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:55.859358 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72340bf7-74d0-41cd-b06f-ec7e0c02541b None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:55.859656 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72340bf7-74d0-41cd-b06f-ec7e0c02541b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:55.865662 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 23/51] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 03:59:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:59:55.871534 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fcdf7e-d91a-4b52-8272-430c1c1a63af None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:55.877991 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-72340bf7-74d0-41cd-b06f-ec7e0c02541b None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:59:55.879215 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-72340bf7-74d0-41cd-b06f-ec7e0c02541b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:55.952575 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 29/52] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 03:59:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:59:55.979660 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fcdf7e-d91a-4b52-8272-430c1c1a63af None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:56.001428 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:56.017252 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09413e-2c66-406e-8fbb-dc63377b86c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:56.017895 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09413e-2c66-406e-8fbb-dc63377b86c6 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:56.018179 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09413e-2c66-406e-8fbb-dc63377b86c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:56.018453 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09413e-2c66-406e-8fbb-dc63377b86c6 None admin] PATH_INFO: `/v3/users/c414fa8ffb744c22a2619f1ccb5b8577` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:56.019645 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09413e-2c66-406e-8fbb-dc63377b86c6 None admin] RBAC: Authorizing `identity:get_user(user_id=c414fa8ffb744c22a2619f1ccb5b8577)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:56.021127 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09413e-2c66-406e-8fbb-dc63377b86c6 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:56.022756 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 24/53] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 24 03:59:55 2022] GET /identity/v3/users/c414fa8ffb744c22a2619f1ccb5b8577 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:59:56.028413 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72340bf7-74d0-41cd-b06f-ec7e0c02541b None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:56.112124 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:56.128151 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72340bf7-74d0-41cd-b06f-ec7e0c02541b None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:56.163296 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ca23a-8165-4ae3-9f3a-1abce4e42f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:56.163933 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ca23a-8165-4ae3-9f3a-1abce4e42f45 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:56.164212 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ca23a-8165-4ae3-9f3a-1abce4e42f45 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:56.164478 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ca23a-8165-4ae3-9f3a-1abce4e42f45 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:56.165612 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755ca23a-8165-4ae3-9f3a-1abce4e42f45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:56.167085 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755ca23a-8165-4ae3-9f3a-1abce4e42f45 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:56.168682 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 30/54] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 03:59:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:59:56.174553 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09413e-2c66-406e-8fbb-dc63377b86c6 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:56.276446 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ca23a-8165-4ae3-9f3a-1abce4e42f45 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:56.277625 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09413e-2c66-406e-8fbb-dc63377b86c6 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:56.317663 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d2035-b764-40d7-8526-049bb46f3744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:56.318296 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d2035-b764-40d7-8526-049bb46f3744 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:56.318579 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d2035-b764-40d7-8526-049bb46f3744 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:56.318853 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d2035-b764-40d7-8526-049bb46f3744 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:56.319616 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0d2035-b764-40d7-8526-049bb46f3744 None admin] RBAC: Adding query filter params (role.id=df6a8bb215d54f71a0b6988a9c01f5e4, scope.domain.id=default, user.id=c414fa8ffb744c22a2619f1ccb5b8577) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:59:56.319927 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0d2035-b764-40d7-8526-049bb46f3744 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:56.321711 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0d2035-b764-40d7-8526-049bb46f3744 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:56.330198 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 25/55] 10.222.0.15 () {56 vars in 1322 bytes} [Wed Aug 24 03:59:56 2022] GET /identity/v3/role_assignments?user.id=c414fa8ffb744c22a2619f1ccb5b8577&scope.domain.id=default&role.id=df6a8bb215d54f71a0b6988a9c01f5e4 => generated 530 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:59:56.387974 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ca23a-8165-4ae3-9f3a-1abce4e42f45 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:56.428482 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d128a88-75fb-4a53-961f-140b4f1d45f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:56.429135 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d128a88-75fb-4a53-961f-140b4f1d45f4 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:56.429415 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d128a88-75fb-4a53-961f-140b4f1d45f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:56.429685 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d128a88-75fb-4a53-961f-140b4f1d45f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:56.430970 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d128a88-75fb-4a53-961f-140b4f1d45f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:56.432544 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d128a88-75fb-4a53-961f-140b4f1d45f4 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:56.434569 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 31/56] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 03:59:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:59:56.441754 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d2035-b764-40d7-8526-049bb46f3744 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:56.501610 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:56.556199 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d2035-b764-40d7-8526-049bb46f3744 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:56.595332 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca21d8-cac5-4683-9e80-59d561eb0431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:56.595951 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca21d8-cac5-4683-9e80-59d561eb0431 None admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:56.596236 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca21d8-cac5-4683-9e80-59d561eb0431 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:56.596512 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca21d8-cac5-4683-9e80-59d561eb0431 None admin] PATH_INFO: `/v3/projects` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:56.597162 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca21d8-cac5-4683-9e80-59d561eb0431 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:56.598603 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca21d8-cac5-4683-9e80-59d561eb0431 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:56.626347 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 26/57] 10.222.0.15 () {60 vars in 1140 bytes} [Wed Aug 24 03:59:56 2022] POST /identity/v3/projects => generated 298 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:59:58.780015 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402f4c8-4876-423a-9fae-693f44ab0248 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:58.780561 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402f4c8-4876-423a-9fae-693f44ab0248 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:58.780561 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402f4c8-4876-423a-9fae-693f44ab0248 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:58.781895 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 32/58] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 03:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:59:58.787519 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005a45d-16d3-4d29-b7b6-5bbed3304f74 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:58.787988 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005a45d-16d3-4d29-b7b6-5bbed3304f74 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:58.788075 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005a45d-16d3-4d29-b7b6-5bbed3304f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:58.807336 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-4005a45d-16d3-4d29-b7b6-5bbed3304f74 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:59:58.808593 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-4005a45d-16d3-4d29-b7b6-5bbed3304f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:58.880246 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 27/59] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 03:59:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:59:59.208017 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402f4c8-4876-423a-9fae-693f44ab0248 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:59.232669 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:59.317165 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402f4c8-4876-423a-9fae-693f44ab0248 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:59.351993 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee826fb0-f4d5-4ec0-84ad-b5d6a1707743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:59.352615 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee826fb0-f4d5-4ec0-84ad-b5d6a1707743 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:59.352891 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee826fb0-f4d5-4ec0-84ad-b5d6a1707743 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:59.353162 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee826fb0-f4d5-4ec0-84ad-b5d6a1707743 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:59.354362 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee826fb0-f4d5-4ec0-84ad-b5d6a1707743 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:59.355868 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee826fb0-f4d5-4ec0-84ad-b5d6a1707743 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:59.357435 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 33/60] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 03:59:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:59:59.363289 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005a45d-16d3-4d29-b7b6-5bbed3304f74 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:59.399649 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:59.472386 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005a45d-16d3-4d29-b7b6-5bbed3304f74 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:59.508110 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed0d83a-a07f-48c2-bfcf-9252bdfac3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:59.508724 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0d83a-a07f-48c2-bfcf-9252bdfac3ac None admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:59.509002 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0d83a-a07f-48c2-bfcf-9252bdfac3ac None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:59.509273 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0d83a-a07f-48c2-bfcf-9252bdfac3ac None admin] PATH_INFO: `/v3/users` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:59.509958 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed0d83a-a07f-48c2-bfcf-9252bdfac3ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:59.511453 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed0d83a-a07f-48c2-bfcf-9252bdfac3ac None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:59.539809 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 28/61] 10.222.0.15 () {60 vars in 1132 bytes} [Wed Aug 24 03:59:59 2022] POST /identity/v3/users => generated 275 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:00:02.980616 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c23129-1938-45ac-b089-8c7fad998cf4 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:02.981580 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c23129-1938-45ac-b089-8c7fad998cf4 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:02.982043 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c23129-1938-45ac-b089-8c7fad998cf4 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:02.983690 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 34/62] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:00:02.989522 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6c369-ee94-4185-a3f7-7632b194ef3c None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:02.990010 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6c369-ee94-4185-a3f7-7632b194ef3c None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:02.990084 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb6c369-ee94-4185-a3f7-7632b194ef3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:03.020779 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-edb6c369-ee94-4185-a3f7-7632b194ef3c None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:03.021993 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-edb6c369-ee94-4185-a3f7-7632b194ef3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:03.063234 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae6ad5-337b-4385-af74-eaea143eb5e5 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:03.063897 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae6ad5-337b-4385-af74-eaea143eb5e5 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:03.064365 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae6ad5-337b-4385-af74-eaea143eb5e5 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:03.066160 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 35/63] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:00:03.079226 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2263d-3669-4948-8cd1-496a91134c54 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:03.079522 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2263d-3669-4948-8cd1-496a91134c54 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:03.079789 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2263d-3669-4948-8cd1-496a91134c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:03.106166 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-91f2263d-3669-4948-8cd1-496a91134c54 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:03.107415 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-91f2263d-3669-4948-8cd1-496a91134c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:03.117641 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 29/64] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:00:03.119624 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086426e-af6a-4bc1-a254-46dd5c582e86 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:03.119925 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086426e-af6a-4bc1-a254-46dd5c582e86 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:03.120206 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086426e-af6a-4bc1-a254-46dd5c582e86 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:03.121892 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 30/65] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:00:03.127871 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18aa6f1-2780-43e6-9dcb-18c92bde2452 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:03.128165 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18aa6f1-2780-43e6-9dcb-18c92bde2452 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:03.128444 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18aa6f1-2780-43e6-9dcb-18c92bde2452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:03.160339 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-d18aa6f1-2780-43e6-9dcb-18c92bde2452 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:03.161474 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-d18aa6f1-2780-43e6-9dcb-18c92bde2452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:03.183458 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 36/66] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:00:03.196677 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:03.281158 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 31/67] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:00:03.496199 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287317f-d959-483c-b89a-ac7a54e8af23 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:03.496856 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287317f-d959-483c-b89a-ac7a54e8af23 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:03.497332 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287317f-d959-483c-b89a-ac7a54e8af23 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:03.499149 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 37/68] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:00:03.504402 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a299985-3912-48f5-93bc-5e793f1312cb None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:03.504955 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a299985-3912-48f5-93bc-5e793f1312cb None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:03.505421 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a299985-3912-48f5-93bc-5e793f1312cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:03.527781 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-4a299985-3912-48f5-93bc-5e793f1312cb None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:03.529319 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-4a299985-3912-48f5-93bc-5e793f1312cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:03.565223 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287317f-d959-483c-b89a-ac7a54e8af23 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:03.586901 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:03.633771 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 32/69] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:00:03.635292 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a299985-3912-48f5-93bc-5e793f1312cb None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:03.686409 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287317f-d959-483c-b89a-ac7a54e8af23 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:03.729712 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e936b-3c53-49ca-9f44-5236220617bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:03.730357 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e936b-3c53-49ca-9f44-5236220617bb None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:03.730639 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e936b-3c53-49ca-9f44-5236220617bb None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:03.730914 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e936b-3c53-49ca-9f44-5236220617bb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:03.736239 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:03.745674 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739e936b-3c53-49ca-9f44-5236220617bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:00:03.752251 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-739e936b-3c53-49ca-9f44-5236220617bb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:00:03.752251 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:00:03.752251 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:00:03.752251 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:00:03.752251 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:00:03.752251 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:00:03.752251 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:00:03.752251 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:00:03.752251 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:00:03.752251 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:00:03.752251 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:00:03.752251 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:00:03.752251 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:00:03.752251 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:00:03.752251 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:00:03.752251 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:00:03.753071 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:00:03.753071 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:00:03.753071 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:00:03.753071 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:00:03.753071 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:00:03.753071 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:00:03.753071 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:00:03.753071 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:00:03.753071 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:00:03.753071 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:00:03.753071 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:00:03.753071 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:00:03.753071 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:00:03.753071 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:00:03.753071 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:00:03.753071 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:00:03.753844 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:00:03.753844 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:00:03.753844 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:00:03.753844 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:00:03.753844 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:00:03.753844 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:00:03.753844 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:00:03.753844 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:00:03.753844 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:00:03.753844 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:00:03.753844 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:00:03.753844 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:00:03.753844 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 38/70] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Aug 24 04:00:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:00:03.760124 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e936b-3c53-49ca-9f44-5236220617bb None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:03.766083 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a299985-3912-48f5-93bc-5e793f1312cb None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:03.811132 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf3751-0565-449a-9778-decf607058bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:03.811808 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf3751-0565-449a-9778-decf607058bf None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:03.812095 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf3751-0565-449a-9778-decf607058bf None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:03.812376 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf3751-0565-449a-9778-decf607058bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:03.827717 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf3751-0565-449a-9778-decf607058bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:00:03.834691 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-5eaf3751-0565-449a-9778-decf607058bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:00:03.834691 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:00:03.834691 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:00:03.834691 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:00:03.834691 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:00:03.834691 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:00:03.834691 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:00:03.834691 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:00:03.834691 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:00:03.834691 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:00:03.834691 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:00:03.834691 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:00:03.834691 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:00:03.834691 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:00:03.834691 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:00:03.834691 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:00:03.835620 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:00:03.835620 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:00:03.835620 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:00:03.835620 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:00:03.835620 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:00:03.835620 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:00:03.835620 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:00:03.835620 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:00:03.835620 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:00:03.835620 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:00:03.835620 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:00:03.835620 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:00:03.835620 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:00:03.835620 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:00:03.835620 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:00:03.835620 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:00:03.836406 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:00:03.836406 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:00:03.836406 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:00:03.836406 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:00:03.836406 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:00:03.836406 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:00:03.836406 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:00:03.836406 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:00:03.836406 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:00:03.836406 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:00:03.836406 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:00:03.836406 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:00:03.839374 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 33/71] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 04:00:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:00:03.840672 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa267a-4ae4-4215-8a09-76a72de4590e None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:03.840960 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa267a-4ae4-4215-8a09-76a72de4590e None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:03.841238 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa267a-4ae4-4215-8a09-76a72de4590e None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:03.842639 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 34/72] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:00:03.843300 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa267a-4ae4-4215-8a09-76a72de4590e None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:03.859159 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:03.883251 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e936b-3c53-49ca-9f44-5236220617bb None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:03.920037 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c24aa-3082-486a-9a86-e75a7fd55bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:03.920654 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c24aa-3082-486a-9a86-e75a7fd55bdb None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:03.920937 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c24aa-3082-486a-9a86-e75a7fd55bdb None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:03.921216 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c24aa-3082-486a-9a86-e75a7fd55bdb None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:03.921879 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1c24aa-3082-486a-9a86-e75a7fd55bdb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:03.922185 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1c24aa-3082-486a-9a86-e75a7fd55bdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:03.923623 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1c24aa-3082-486a-9a86-e75a7fd55bdb None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:03.938216 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 39/73] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 24 04:00:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:03.939388 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c24aa-3082-486a-9a86-e75a7fd55bdb None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:03.959440 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa267a-4ae4-4215-8a09-76a72de4590e None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:03.998242 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f8c5c-5061-49cd-a993-36654ed39187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:03.998874 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f8c5c-5061-49cd-a993-36654ed39187 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:03.999225 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f8c5c-5061-49cd-a993-36654ed39187 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:03.999498 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f8c5c-5061-49cd-a993-36654ed39187 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:04.008109 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:04.011176 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f8c5c-5061-49cd-a993-36654ed39187 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:00:04.017001 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-667f8c5c-5061-49cd-a993-36654ed39187 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:00:04.017001 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:00:04.017001 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:00:04.017001 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:00:04.017001 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:00:04.017001 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:00:04.017001 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:00:04.017001 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:00:04.017001 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:00:04.017001 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:00:04.017001 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:00:04.017001 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:00:04.017001 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:00:04.017001 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:00:04.017001 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:00:04.017001 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:00:04.017899 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:00:04.017899 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:00:04.017899 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:00:04.017899 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:00:04.017899 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:00:04.017899 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:00:04.017899 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:00:04.017899 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:00:04.017899 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:00:04.017899 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:00:04.017899 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:00:04.017899 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:00:04.017899 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:00:04.017899 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:00:04.017899 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:00:04.017899 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:00:04.019499 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:00:04.019499 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:00:04.019499 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:00:04.019499 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:00:04.019499 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:00:04.019499 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:00:04.019499 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:00:04.019499 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:00:04.019499 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:00:04.019499 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:00:04.019499 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:00:04.019499 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:00:04.019499 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 35/74] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 24 04:00:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:00:04.020573 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a51b2-7815-4c55-9721-27951c592ef8 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:04.020857 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a51b2-7815-4c55-9721-27951c592ef8 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:04.021131 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a51b2-7815-4c55-9721-27951c592ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:04.039144 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-fc1a51b2-7815-4c55-9721-27951c592ef8 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:04.040387 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-fc1a51b2-7815-4c55-9721-27951c592ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:04.047112 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c24aa-3082-486a-9a86-e75a7fd55bdb None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:04.082119 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0850d5f-a0bf-4584-adf5-07045620564c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:04.082743 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0850d5f-a0bf-4584-adf5-07045620564c None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:04.083030 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0850d5f-a0bf-4584-adf5-07045620564c None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:04.083343 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0850d5f-a0bf-4584-adf5-07045620564c None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:04.084021 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0850d5f-a0bf-4584-adf5-07045620564c None admin] RBAC: Adding query filter params (name=member) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:04.084331 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0850d5f-a0bf-4584-adf5-07045620564c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:04.085744 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0850d5f-a0bf-4584-adf5-07045620564c None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:04.094455 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 40/75] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 24 04:00:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:04.095494 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0850d5f-a0bf-4584-adf5-07045620564c None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:04.098082 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:04.116979 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 36/76] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:00:04.117891 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a51b2-7815-4c55-9721-27951c592ef8 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:04.201267 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0850d5f-a0bf-4584-adf5-07045620564c None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:04.239079 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a51b2-7815-4c55-9721-27951c592ef8 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:04.240667 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94b111-60c8-4960-b0be-fec279da7b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:04.241327 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94b111-60c8-4960-b0be-fec279da7b7c None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:04.241613 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94b111-60c8-4960-b0be-fec279da7b7c None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:04.241897 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94b111-60c8-4960-b0be-fec279da7b7c None admin] PATH_INFO: `/v3/users/fd730780576745e9955cd5f707848429` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:04.255968 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b94b111-60c8-4960-b0be-fec279da7b7c None admin] RBAC: Authorizing `identity:get_user(user_id=fd730780576745e9955cd5f707848429)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:04.257616 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b94b111-60c8-4960-b0be-fec279da7b7c None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:04.259400 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 41/77] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 24 04:00:04 2022] GET /identity/v3/users/fd730780576745e9955cd5f707848429 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:04.260121 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94b111-60c8-4960-b0be-fec279da7b7c None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:04.273186 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:04.280478 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a479456-c1c8-47e5-93d9-2002649977f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:04.281394 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a479456-c1c8-47e5-93d9-2002649977f7 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:04.281850 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a479456-c1c8-47e5-93d9-2002649977f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:04.282393 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a479456-c1c8-47e5-93d9-2002649977f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:04.294118 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a479456-c1c8-47e5-93d9-2002649977f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:00:04.298886 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-4a479456-c1c8-47e5-93d9-2002649977f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:00:04.298886 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:00:04.298886 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:00:04.298886 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:00:04.298886 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:00:04.298886 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:00:04.298886 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:00:04.298886 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:00:04.298886 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:00:04.298886 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:00:04.298886 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:00:04.298886 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:00:04.298886 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:00:04.298886 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:00:04.298886 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:00:04.298886 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:00:04.299851 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:00:04.299851 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:00:04.299851 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:00:04.299851 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:00:04.299851 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:00:04.299851 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:00:04.299851 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:00:04.299851 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:00:04.299851 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:00:04.299851 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:00:04.299851 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:00:04.299851 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:00:04.299851 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:00:04.299851 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:00:04.299851 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:00:04.299851 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:00:04.300611 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:00:04.300611 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:00:04.300611 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:00:04.300611 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:00:04.300611 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:00:04.300611 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:00:04.300611 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:00:04.300611 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:00:04.300611 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:00:04.300611 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:00:04.300611 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:00:04.300611 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:00:04.300611 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 37/78] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 04:00:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:00:04.301224 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a479456-c1c8-47e5-93d9-2002649977f7 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:04.331758 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:04.378740 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94b111-60c8-4960-b0be-fec279da7b7c None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:04.408992 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a479456-c1c8-47e5-93d9-2002649977f7 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:04.416070 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82031d68-1b97-46bf-839e-32739f01d922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:04.417366 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82031d68-1b97-46bf-839e-32739f01d922 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:04.417861 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82031d68-1b97-46bf-839e-32739f01d922 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:04.418391 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82031d68-1b97-46bf-839e-32739f01d922 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:04.419620 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82031d68-1b97-46bf-839e-32739f01d922 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:04.420413 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82031d68-1b97-46bf-839e-32739f01d922 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:04.422306 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82031d68-1b97-46bf-839e-32739f01d922 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:04.433649 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 42/79] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 04:00:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:04.434955 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82031d68-1b97-46bf-839e-32739f01d922 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:04.444096 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988c120-95a3-4337-a7ff-8b878b31099e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:04.444734 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988c120-95a3-4337-a7ff-8b878b31099e None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:04.445019 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988c120-95a3-4337-a7ff-8b878b31099e None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:04.445611 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988c120-95a3-4337-a7ff-8b878b31099e None admin] PATH_INFO: `/v3/users/fd730780576745e9955cd5f707848429` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:04.446779 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a988c120-95a3-4337-a7ff-8b878b31099e None admin] RBAC: Authorizing `identity:get_user(user_id=fd730780576745e9955cd5f707848429)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:04.448358 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a988c120-95a3-4337-a7ff-8b878b31099e None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:04.450129 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 38/80] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 24 04:00:04 2022] GET /identity/v3/users/fd730780576745e9955cd5f707848429 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:04.450817 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988c120-95a3-4337-a7ff-8b878b31099e None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:04.513202 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:04.553809 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82031d68-1b97-46bf-839e-32739f01d922 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:04.558173 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988c120-95a3-4337-a7ff-8b878b31099e None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:04.577278 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:04.589040 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c8765b-dc71-4955-93b1-5ba5129dfe81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:04.589660 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8765b-dc71-4955-93b1-5ba5129dfe81 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:04.589936 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8765b-dc71-4955-93b1-5ba5129dfe81 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:04.590210 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8765b-dc71-4955-93b1-5ba5129dfe81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:04.593246 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb508928-31e2-4c69-a96f-0515016ea6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:04.593853 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb508928-31e2-4c69-a96f-0515016ea6db None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:04.594126 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb508928-31e2-4c69-a96f-0515016ea6db None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:04.594401 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb508928-31e2-4c69-a96f-0515016ea6db None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:04.595062 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb508928-31e2-4c69-a96f-0515016ea6db None admin] RBAC: Adding query filter params (name=member) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:04.595397 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb508928-31e2-4c69-a96f-0515016ea6db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:04.596784 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb508928-31e2-4c69-a96f-0515016ea6db None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:04.604943 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 39/81] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 24 04:00:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:04.604943 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb508928-31e2-4c69-a96f-0515016ea6db None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:04.667434 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c8765b-dc71-4955-93b1-5ba5129dfe81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:04.668933 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c8765b-dc71-4955-93b1-5ba5129dfe81 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:04.706205 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb508928-31e2-4c69-a96f-0515016ea6db None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:04.726767 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:04.741912 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc788e-0c07-4a56-8bca-540d4ff3f7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:04.742549 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc788e-0c07-4a56-8bca-540d4ff3f7e0 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:04.742828 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc788e-0c07-4a56-8bca-540d4ff3f7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:04.743102 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc788e-0c07-4a56-8bca-540d4ff3f7e0 None admin] PATH_INFO: `/v3/users/c414fa8ffb744c22a2619f1ccb5b8577` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:04.744264 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdc788e-0c07-4a56-8bca-540d4ff3f7e0 None admin] RBAC: Authorizing `identity:get_user(user_id=c414fa8ffb744c22a2619f1ccb5b8577)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:04.745726 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdc788e-0c07-4a56-8bca-540d4ff3f7e0 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:04.747328 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 40/82] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 24 04:00:04 2022] GET /identity/v3/users/c414fa8ffb744c22a2619f1ccb5b8577 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:04.748108 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc788e-0c07-4a56-8bca-540d4ff3f7e0 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:04.777639 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 43/83] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 24 04:00:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:04.778408 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c8765b-dc71-4955-93b1-5ba5129dfe81 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:04.802208 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:04.851141 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc788e-0c07-4a56-8bca-540d4ff3f7e0 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:04.878657 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c8765b-dc71-4955-93b1-5ba5129dfe81 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:04.888016 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf3e32-eac5-46ff-821b-5c5a5f34b433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:04.888651 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf3e32-eac5-46ff-821b-5c5a5f34b433 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:04.888933 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf3e32-eac5-46ff-821b-5c5a5f34b433 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:04.889209 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf3e32-eac5-46ff-821b-5c5a5f34b433 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:04.916554 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca2543a-be40-45bb-b78a-f5b84f4c35d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:04.917432 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2543a-be40-45bb-b78a-f5b84f4c35d5 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:04.917843 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2543a-be40-45bb-b78a-f5b84f4c35d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:04.918325 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2543a-be40-45bb-b78a-f5b84f4c35d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:04.920122 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca2543a-be40-45bb-b78a-f5b84f4c35d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:04.922450 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca2543a-be40-45bb-b78a-f5b84f4c35d5 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:04.925065 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 44/84] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:00:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:04.928831 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca2543a-be40-45bb-b78a-f5b84f4c35d5 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:04.957687 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:04.972268 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf3e32-eac5-46ff-821b-5c5a5f34b433 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:04.973798 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf3e32-eac5-46ff-821b-5c5a5f34b433 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:05.027255 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:05.037755 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca2543a-be40-45bb-b78a-f5b84f4c35d5 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:05.075227 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6b90f-590f-47b7-baad-7d10901b4aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:05.075946 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6b90f-590f-47b7-baad-7d10901b4aeb None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:05.076184 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6b90f-590f-47b7-baad-7d10901b4aeb None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:05.076482 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6b90f-590f-47b7-baad-7d10901b4aeb None admin] PATH_INFO: `/v3/users/fd730780576745e9955cd5f707848429` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:05.077969 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e6b90f-590f-47b7-baad-7d10901b4aeb None admin] RBAC: Authorizing `identity:get_user(user_id=fd730780576745e9955cd5f707848429)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:05.079480 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e6b90f-590f-47b7-baad-7d10901b4aeb None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:05.079825 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 41/85] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 24 04:00:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:05.080681 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf3e32-eac5-46ff-821b-5c5a5f34b433 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:05.085374 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 45/86] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 24 04:00:04 2022] GET /identity/v3/users/fd730780576745e9955cd5f707848429 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:05.086567 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6b90f-590f-47b7-baad-7d10901b4aeb None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:05.174819 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:05.187906 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf3e32-eac5-46ff-821b-5c5a5f34b433 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:05.191603 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6b90f-590f-47b7-baad-7d10901b4aeb None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:05.224390 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0eb393-d4e8-4f22-acb7-126c66ade23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:05.225010 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0eb393-d4e8-4f22-acb7-126c66ade23e None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:05.225292 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0eb393-d4e8-4f22-acb7-126c66ade23e None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:05.225556 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0eb393-d4e8-4f22-acb7-126c66ade23e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:05.227096 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6d0fe-432d-4daa-9567-bd235b5a1bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:05.227801 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6d0fe-432d-4daa-9567-bd235b5a1bca None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:05.228312 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6d0fe-432d-4daa-9567-bd235b5a1bca None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:05.228461 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6d0fe-432d-4daa-9567-bd235b5a1bca None admin] PATH_INFO: `/v3/projects/b8831e7463bf44df920eb14d1ccf1502` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:05.233820 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e6d0fe-432d-4daa-9567-bd235b5a1bca None admin] RBAC: Authorizing `identity:get_project(project_id=b8831e7463bf44df920eb14d1ccf1502)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:05.235791 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e6d0fe-432d-4daa-9567-bd235b5a1bca None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:05.237886 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 46/87] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 24 04:00:05 2022] GET /identity/v3/projects/b8831e7463bf44df920eb14d1ccf1502 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:05.239048 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6d0fe-432d-4daa-9567-bd235b5a1bca None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:05.272496 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:05.302356 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0eb393-d4e8-4f22-acb7-126c66ade23e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:05.303811 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0eb393-d4e8-4f22-acb7-126c66ade23e None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:05.354900 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6d0fe-432d-4daa-9567-bd235b5a1bca None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:05.391097 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4fcac0-ab19-43ed-a0b3-52b63484e9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:05.392034 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fcac0-ab19-43ed-a0b3-52b63484e9a8 None admin] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:05.392034 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fcac0-ab19-43ed-a0b3-52b63484e9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:05.392275 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fcac0-ab19-43ed-a0b3-52b63484e9a8 None admin] PATH_INFO: `/v3/users` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:05.392922 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4fcac0-ab19-43ed-a0b3-52b63484e9a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:05.394380 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4fcac0-ab19-43ed-a0b3-52b63484e9a8 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:05.396766 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:05.411732 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 42/88] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 24 04:00:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:05.412585 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0eb393-d4e8-4f22-acb7-126c66ade23e None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:05.427455 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 47/89] 10.222.0.15 () {60 vars in 1132 bytes} [Wed Aug 24 04:00:05 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:00:05.428304 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4fcac0-ab19-43ed-a0b3-52b63484e9a8 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:05.535635 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0eb393-d4e8-4f22-acb7-126c66ade23e None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:05.541197 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:05.567498 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4fcac0-ab19-43ed-a0b3-52b63484e9a8 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:05.579914 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5e5ee-bfb3-4853-93f7-324462a7345f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:05.581096 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5e5ee-bfb3-4853-93f7-324462a7345f None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:05.581565 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5e5ee-bfb3-4853-93f7-324462a7345f None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:05.582006 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5e5ee-bfb3-4853-93f7-324462a7345f None admin] PATH_INFO: `/v3/projects/b8831e7463bf44df920eb14d1ccf1502` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:05.583809 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5e5ee-bfb3-4853-93f7-324462a7345f None admin] RBAC: Authorizing `identity:get_project(project_id=b8831e7463bf44df920eb14d1ccf1502)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:05.585929 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5e5ee-bfb3-4853-93f7-324462a7345f None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:05.588741 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 43/90] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 24 04:00:05 2022] GET /identity/v3/projects/b8831e7463bf44df920eb14d1ccf1502 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:05.589905 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5e5ee-bfb3-4853-93f7-324462a7345f None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:05.625750 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e9fef-e078-4e51-97e9-7e942ebdc7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:05.626547 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e9fef-e078-4e51-97e9-7e942ebdc7d8 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:05.627009 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e9fef-e078-4e51-97e9-7e942ebdc7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:05.627488 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e9fef-e078-4e51-97e9-7e942ebdc7d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:05.673043 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:05.721547 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e9fef-e078-4e51-97e9-7e942ebdc7d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:05.723069 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e9fef-e078-4e51-97e9-7e942ebdc7d8 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:05.739969 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5e5ee-bfb3-4853-93f7-324462a7345f None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:05.788102 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a35fa8-21b8-48c5-8baa-bba46274abc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:05.788713 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a35fa8-21b8-48c5-8baa-bba46274abc5 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:05.788990 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a35fa8-21b8-48c5-8baa-bba46274abc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:05.789259 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a35fa8-21b8-48c5-8baa-bba46274abc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:05.789989 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a35fa8-21b8-48c5-8baa-bba46274abc5 None admin] RBAC: Adding query filter params (role.id=a9f3803644ca4a6fab51b9513141be7b, scope.project.id=b8831e7463bf44df920eb14d1ccf1502, user.id=fd730780576745e9955cd5f707848429) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:05.790295 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a35fa8-21b8-48c5-8baa-bba46274abc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:05.791956 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a35fa8-21b8-48c5-8baa-bba46274abc5 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:05.798688 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 44/91] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 24 04:00:05 2022] GET /identity/v3/role_assignments?user.id=fd730780576745e9955cd5f707848429&scope.project.id=b8831e7463bf44df920eb14d1ccf1502&role.id=a9f3803644ca4a6fab51b9513141be7b => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:05.799592 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a35fa8-21b8-48c5-8baa-bba46274abc5 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:05.830577 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:05.853942 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 48/92] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 24 04:00:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:05.855074 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e9fef-e078-4e51-97e9-7e942ebdc7d8 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:05.954212 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a35fa8-21b8-48c5-8baa-bba46274abc5 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:05.979491 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:06.021543 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb770165-066f-4830-92a3-5e2f4b4978f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:06.022216 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb770165-066f-4830-92a3-5e2f4b4978f7 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:06.022502 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb770165-066f-4830-92a3-5e2f4b4978f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:06.022779 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb770165-066f-4830-92a3-5e2f4b4978f7 None admin] PATH_INFO: `/v3/projects/b8831e7463bf44df920eb14d1ccf1502` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:06.024320 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb770165-066f-4830-92a3-5e2f4b4978f7 None admin] RBAC: Authorizing `identity:get_project(project_id=b8831e7463bf44df920eb14d1ccf1502)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:06.025900 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb770165-066f-4830-92a3-5e2f4b4978f7 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:06.027492 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 45/93] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 24 04:00:05 2022] GET /identity/v3/projects/b8831e7463bf44df920eb14d1ccf1502 => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:06.028318 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb770165-066f-4830-92a3-5e2f4b4978f7 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:06.034188 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e9fef-e078-4e51-97e9-7e942ebdc7d8 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:06.077071 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ff93d-d00f-43a4-bfa4-08cd457074cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:06.077841 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ff93d-d00f-43a4-bfa4-08cd457074cf None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:06.078027 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ff93d-d00f-43a4-bfa4-08cd457074cf None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:06.078304 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ff93d-d00f-43a4-bfa4-08cd457074cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:06.079936 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ff93d-d00f-43a4-bfa4-08cd457074cf None admin] RBAC: Adding query filter params (role.id=5d03284e31284f60bcc99e4843279067, scope.project.id=b8831e7463bf44df920eb14d1ccf1502, user.id=fd730780576745e9955cd5f707848429) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:06.080442 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ff93d-d00f-43a4-bfa4-08cd457074cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:06.082139 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ff93d-d00f-43a4-bfa4-08cd457074cf None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:06.089303 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 49/94] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 24 04:00:05 2022] GET /identity/v3/role_assignments?user.id=fd730780576745e9955cd5f707848429&scope.project.id=b8831e7463bf44df920eb14d1ccf1502&role.id=5d03284e31284f60bcc99e4843279067 => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:06.090245 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ff93d-d00f-43a4-bfa4-08cd457074cf None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:06.165293 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:06.167988 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb770165-066f-4830-92a3-5e2f4b4978f7 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:06.209889 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95529da-095e-411b-a21c-7834709b979c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:06.210549 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95529da-095e-411b-a21c-7834709b979c None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:06.210843 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95529da-095e-411b-a21c-7834709b979c None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:06.211177 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95529da-095e-411b-a21c-7834709b979c None admin] PATH_INFO: `/v3/projects/d48fb0f516b742648ed34ee191ac5dd8` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:06.213195 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95529da-095e-411b-a21c-7834709b979c None admin] RBAC: Authorizing `identity:get_project(project_id=d48fb0f516b742648ed34ee191ac5dd8)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:06.213974 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95529da-095e-411b-a21c-7834709b979c None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:06.216220 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 46/95] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 24 04:00:06 2022] GET /identity/v3/projects/d48fb0f516b742648ed34ee191ac5dd8 => generated 312 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:06.228431 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95529da-095e-411b-a21c-7834709b979c None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:06.265326 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ff93d-d00f-43a4-bfa4-08cd457074cf None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:06.295709 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:06.333415 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6540403-f117-48de-96e2-f0499326ab5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:06.334399 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6540403-f117-48de-96e2-f0499326ab5b None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:06.334881 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6540403-f117-48de-96e2-f0499326ab5b None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:06.339519 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6540403-f117-48de-96e2-f0499326ab5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:06.340739 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6540403-f117-48de-96e2-f0499326ab5b None admin] RBAC: Adding query filter params (role.id=df6a8bb215d54f71a0b6988a9c01f5e4, scope.project.id=b8831e7463bf44df920eb14d1ccf1502, user.id=c414fa8ffb744c22a2619f1ccb5b8577) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:06.341256 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6540403-f117-48de-96e2-f0499326ab5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:06.342975 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6540403-f117-48de-96e2-f0499326ab5b None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:06.355229 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 50/96] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 24 04:00:06 2022] GET /identity/v3/role_assignments?user.id=c414fa8ffb744c22a2619f1ccb5b8577&scope.project.id=b8831e7463bf44df920eb14d1ccf1502&role.id=df6a8bb215d54f71a0b6988a9c01f5e4 => generated 259 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:06.355430 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95529da-095e-411b-a21c-7834709b979c None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:06.393806 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445dadf4-6497-4096-a316-7ff0032e86ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:06.394534 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445dadf4-6497-4096-a316-7ff0032e86ed None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:06.394825 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445dadf4-6497-4096-a316-7ff0032e86ed None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:06.395164 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445dadf4-6497-4096-a316-7ff0032e86ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:06.396001 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445dadf4-6497-4096-a316-7ff0032e86ed None admin] RBAC: Adding query filter params (role.id=5d03284e31284f60bcc99e4843279067, scope.project.id=d48fb0f516b742648ed34ee191ac5dd8, user.id=fd730780576745e9955cd5f707848429) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:06.396373 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445dadf4-6497-4096-a316-7ff0032e86ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:06.397944 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445dadf4-6497-4096-a316-7ff0032e86ed None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:06.404853 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 47/97] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 24 04:00:06 2022] GET /identity/v3/role_assignments?user.id=fd730780576745e9955cd5f707848429&scope.project.id=d48fb0f516b742648ed34ee191ac5dd8&role.id=5d03284e31284f60bcc99e4843279067 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:00:08.425207 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d058d-a953-4665-9621-d44c06a86b0c None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:08.425800 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d058d-a953-4665-9621-d44c06a86b0c None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:08.425800 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d058d-a953-4665-9621-d44c06a86b0c None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:08.427310 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 51/98] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:00:08.433788 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72b5e7-6e21-4d9b-a36b-ec1832b4c90e None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:08.434659 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72b5e7-6e21-4d9b-a36b-ec1832b4c90e None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:08.435151 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72b5e7-6e21-4d9b-a36b-ec1832b4c90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:08.456073 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-9b72b5e7-6e21-4d9b-a36b-ec1832b4c90e None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:08.457652 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-9b72b5e7-6e21-4d9b-a36b-ec1832b4c90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:08.539223 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 48/99] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:00:08.690362 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b03bc-e1e4-4139-a94e-7a9fcbf8a5f3 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:08.690971 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b03bc-e1e4-4139-a94e-7a9fcbf8a5f3 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:08.691469 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b03bc-e1e4-4139-a94e-7a9fcbf8a5f3 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:08.693419 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 52/100] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:00:08.699516 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2845e8c-bdb0-4040-914b-6b95a62c09e4 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:08.700112 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2845e8c-bdb0-4040-914b-6b95a62c09e4 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:08.700587 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2845e8c-bdb0-4040-914b-6b95a62c09e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:08.727939 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-e2845e8c-bdb0-4040-914b-6b95a62c09e4 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:08.729676 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-e2845e8c-bdb0-4040-914b-6b95a62c09e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:08.795219 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:08.818046 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 49/101] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:00:09.109096 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b03bc-e1e4-4139-a94e-7a9fcbf8a5f3 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:09.245749 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b03bc-e1e4-4139-a94e-7a9fcbf8a5f3 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:09.261708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:09.306326 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2860993-423a-495e-8d7d-af894d6820c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:09.307465 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2860993-423a-495e-8d7d-af894d6820c3 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:09.307954 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2860993-423a-495e-8d7d-af894d6820c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:09.308431 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2860993-423a-495e-8d7d-af894d6820c3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:09.329905 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2860993-423a-495e-8d7d-af894d6820c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:00:09.335381 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-e2860993-423a-495e-8d7d-af894d6820c3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:00:09.335381 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:00:09.335381 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:00:09.335381 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:00:09.335381 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:00:09.335381 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:00:09.335381 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:00:09.335381 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:00:09.335381 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:00:09.335381 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:00:09.335381 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:00:09.335381 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:00:09.335381 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:00:09.335381 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:00:09.335381 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:00:09.335381 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:00:09.336269 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:00:09.336269 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:00:09.336269 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:00:09.336269 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:00:09.336269 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:00:09.336269 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:00:09.336269 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:00:09.336269 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:00:09.336269 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:00:09.336269 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:00:09.336269 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:00:09.336269 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:00:09.336269 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:00:09.336269 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:00:09.336269 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:00:09.336269 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:00:09.337012 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:00:09.337012 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:00:09.337012 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:00:09.337012 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:00:09.337012 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:00:09.337012 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:00:09.337012 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:00:09.337012 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:00:09.337012 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:00:09.337012 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:00:09.337012 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:00:09.337012 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:00:09.339698 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 53/102] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 04:00:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:00:09.346096 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2845e8c-bdb0-4040-914b-6b95a62c09e4 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:09.467288 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2860993-423a-495e-8d7d-af894d6820c3 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:09.488742 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2845e8c-bdb0-4040-914b-6b95a62c09e4 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:09.612532 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef7b36a-33c2-4cf1-a304-3bb77404b788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:09.613161 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7b36a-33c2-4cf1-a304-3bb77404b788 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:09.613444 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7b36a-33c2-4cf1-a304-3bb77404b788 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:09.613735 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7b36a-33c2-4cf1-a304-3bb77404b788 None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:09.614391 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef7b36a-33c2-4cf1-a304-3bb77404b788 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:09.614697 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef7b36a-33c2-4cf1-a304-3bb77404b788 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:09.616132 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef7b36a-33c2-4cf1-a304-3bb77404b788 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:09.634518 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 50/103] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 24 04:00:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:00:09.640356 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef7b36a-33c2-4cf1-a304-3bb77404b788 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:09.646827 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2860993-423a-495e-8d7d-af894d6820c3 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:09.720883 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19b8c5-ca64-4153-9855-0241caa2b7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:09.722022 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19b8c5-ca64-4153-9855-0241caa2b7ee None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:09.722499 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19b8c5-ca64-4153-9855-0241caa2b7ee None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:09.722982 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19b8c5-ca64-4153-9855-0241caa2b7ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:09.728115 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a19b8c5-ca64-4153-9855-0241caa2b7ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:09.729957 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a19b8c5-ca64-4153-9855-0241caa2b7ee None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:09.732010 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 54/104] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:00:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:00:09.733480 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1abd0de-1e2d-49b6-8c47-b6197d08fa8e None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:09.733981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1abd0de-1e2d-49b6-8c47-b6197d08fa8e None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:09.734446 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1abd0de-1e2d-49b6-8c47-b6197d08fa8e None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:09.735970 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 55/105] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:00:09.756309 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1abd0de-1e2d-49b6-8c47-b6197d08fa8e None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:09.756501 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:09.819774 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef7b36a-33c2-4cf1-a304-3bb77404b788 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:09.820340 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:09.854318 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e42831-3fdd-4d8f-a278-7ddb2b24a761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:09.854950 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e42831-3fdd-4d8f-a278-7ddb2b24a761 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:09.855257 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e42831-3fdd-4d8f-a278-7ddb2b24a761 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:09.855530 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e42831-3fdd-4d8f-a278-7ddb2b24a761 None admin] PATH_INFO: `/v3/users/e175ccc6442840e5bacc0d9965ecb103` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:09.870887 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e42831-3fdd-4d8f-a278-7ddb2b24a761 None admin] RBAC: Authorizing `identity:get_user(user_id=e175ccc6442840e5bacc0d9965ecb103)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:09.872371 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e42831-3fdd-4d8f-a278-7ddb2b24a761 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:09.874036 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 51/106] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 24 04:00:09 2022] GET /identity/v3/users/e175ccc6442840e5bacc0d9965ecb103 => generated 289 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:00:09.874036 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e0293-d30c-43fb-ac38-15fc329b13c8 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:09.874036 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e0293-d30c-43fb-ac38-15fc329b13c8 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:09.874036 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e0293-d30c-43fb-ac38-15fc329b13c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:09.894668 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-555e0293-d30c-43fb-ac38-15fc329b13c8 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:09.896030 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1abd0de-1e2d-49b6-8c47-b6197d08fa8e None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:09.896113 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-555e0293-d30c-43fb-ac38-15fc329b13c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:09.931718 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c42c8f-9637-4e10-987b-129dc9800bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:09.932618 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c42c8f-9637-4e10-987b-129dc9800bbd None admin] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:09.932903 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c42c8f-9637-4e10-987b-129dc9800bbd None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:09.933182 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c42c8f-9637-4e10-987b-129dc9800bbd None admin] PATH_INFO: `/v3/projects` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:09.933840 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c42c8f-9637-4e10-987b-129dc9800bbd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:09.935371 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c42c8f-9637-4e10-987b-129dc9800bbd None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:09.963385 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 56/107] 10.222.0.15 () {60 vars in 1141 bytes} [Wed Aug 24 04:00:09 2022] POST /identity/v3/projects => generated 302 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:00:09.964645 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef984d3-3e09-476c-b4d8-dc10251baef5 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:09.964937 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef984d3-3e09-476c-b4d8-dc10251baef5 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:09.965395 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef984d3-3e09-476c-b4d8-dc10251baef5 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:09.971348 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 57/108] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:00:09.971348 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cffd8-8865-4d8d-a850-bfcfa5f5a92b None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:09.971348 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cffd8-8865-4d8d-a850-bfcfa5f5a92b None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:09.971348 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342cffd8-8865-4d8d-a850-bfcfa5f5a92b None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:09.971348 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 58/109] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:00:09.971348 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342cffd8-8865-4d8d-a850-bfcfa5f5a92b None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:09.979360 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 52/110] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:00:09.991286 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ff0c5-38bb-4031-acb2-c0db477668b7 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:09.991286 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ff0c5-38bb-4031-acb2-c0db477668b7 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:09.991286 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ff0c5-38bb-4031-acb2-c0db477668b7 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:09.991286 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 53/111] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:00:09.991286 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243ff85-9df5-4cec-bb4e-98f7b05a6e1c None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:09.991286 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243ff85-9df5-4cec-bb4e-98f7b05a6e1c None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:09.991781 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243ff85-9df5-4cec-bb4e-98f7b05a6e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:10.020585 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-8243ff85-9df5-4cec-bb4e-98f7b05a6e1c None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:10.022914 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-8243ff85-9df5-4cec-bb4e-98f7b05a6e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:10.057728 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:10.112170 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:10.123620 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 54/112] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:00:10.123620 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4256263-0e03-4352-bcef-e17ea4139aee None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:10.123620 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4256263-0e03-4352-bcef-e17ea4139aee None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:10.123620 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4256263-0e03-4352-bcef-e17ea4139aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:10.145126 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342cffd8-8865-4d8d-a850-bfcfa5f5a92b None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:10.156312 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-f4256263-0e03-4352-bcef-e17ea4139aee None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:10.157514 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-f4256263-0e03-4352-bcef-e17ea4139aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:10.192993 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c939a17-88be-4ff1-8321-bfef9fcd9e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:10.193766 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c939a17-88be-4ff1-8321-bfef9fcd9e2d None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:10.194353 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c939a17-88be-4ff1-8321-bfef9fcd9e2d None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:10.195565 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c939a17-88be-4ff1-8321-bfef9fcd9e2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:10.237951 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 55/113] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:00:10.239080 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00155bb5-4578-4505-81b2-30fc15e31939 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:10.239500 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00155bb5-4578-4505-81b2-30fc15e31939 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:10.239865 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00155bb5-4578-4505-81b2-30fc15e31939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:10.269888 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-00155bb5-4578-4505-81b2-30fc15e31939 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:10.271087 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-00155bb5-4578-4505-81b2-30fc15e31939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:10.306845 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c939a17-88be-4ff1-8321-bfef9fcd9e2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:10.308370 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c939a17-88be-4ff1-8321-bfef9fcd9e2d None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:10.375698 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 56/114] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:00:10.376379 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00155bb5-4578-4505-81b2-30fc15e31939 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:10.408199 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:10.422601 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:10.441923 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 59/115] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 24 04:00:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:10.448416 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c939a17-88be-4ff1-8321-bfef9fcd9e2d None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:10.510970 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00155bb5-4578-4505-81b2-30fc15e31939 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:10.557170 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721d52b-2ebd-454b-8f64-afddf3bc5e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:10.558360 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721d52b-2ebd-454b-8f64-afddf3bc5e0a None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:10.558780 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721d52b-2ebd-454b-8f64-afddf3bc5e0a None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:10.559062 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721d52b-2ebd-454b-8f64-afddf3bc5e0a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:10.575282 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c939a17-88be-4ff1-8321-bfef9fcd9e2d None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:10.577857 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721d52b-2ebd-454b-8f64-afddf3bc5e0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:00:10.592360 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-4721d52b-2ebd-454b-8f64-afddf3bc5e0a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:00:10.592360 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:00:10.592360 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:00:10.592360 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:00:10.592360 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:00:10.592360 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:00:10.592360 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:00:10.592360 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:00:10.592360 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:00:10.592360 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:00:10.592360 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:00:10.592360 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:00:10.592360 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:00:10.592360 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:00:10.592360 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:00:10.592360 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:00:10.593216 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:00:10.593216 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:00:10.593216 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:00:10.593216 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:00:10.593216 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:00:10.593216 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:00:10.593216 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:00:10.593216 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:00:10.593216 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:00:10.593216 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:00:10.593216 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:00:10.593216 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:00:10.593216 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:00:10.593216 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:00:10.593216 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:00:10.593216 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:00:10.594382 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:00:10.594382 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:00:10.594382 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:00:10.594382 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:00:10.594382 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:00:10.594382 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:00:10.594382 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:00:10.594382 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:00:10.594382 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:00:10.594382 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:00:10.594382 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:00:10.594382 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:00:10.594382 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 57/116] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 04:00:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:00:10.595004 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721d52b-2ebd-454b-8f64-afddf3bc5e0a None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:10.683914 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c041c41-502d-4b5f-bc80-10565d74e4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:10.684951 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c041c41-502d-4b5f-bc80-10565d74e4f8 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:10.685426 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c041c41-502d-4b5f-bc80-10565d74e4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:10.685891 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c041c41-502d-4b5f-bc80-10565d74e4f8 None admin] PATH_INFO: `/v3/projects/b8831e7463bf44df920eb14d1ccf1502` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:10.687317 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c041c41-502d-4b5f-bc80-10565d74e4f8 None admin] RBAC: Authorizing `identity:get_project(project_id=b8831e7463bf44df920eb14d1ccf1502)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:10.689008 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c041c41-502d-4b5f-bc80-10565d74e4f8 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:10.690865 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 60/117] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 24 04:00:10 2022] GET /identity/v3/projects/b8831e7463bf44df920eb14d1ccf1502 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:00:10.691653 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:10.692895 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c041c41-502d-4b5f-bc80-10565d74e4f8 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:10.711698 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721d52b-2ebd-454b-8f64-afddf3bc5e0a None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:10.748084 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2baba84-eca6-465c-9468-c617f7d60189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:10.748723 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2baba84-eca6-465c-9468-c617f7d60189 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:10.749006 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2baba84-eca6-465c-9468-c617f7d60189 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:10.749283 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2baba84-eca6-465c-9468-c617f7d60189 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:10.761591 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2baba84-eca6-465c-9468-c617f7d60189 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:00:10.766526 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-e2baba84-eca6-465c-9468-c617f7d60189 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:00:10.766526 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:00:10.766526 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:00:10.766526 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:00:10.766526 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:00:10.766526 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:00:10.766526 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:00:10.766526 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:00:10.766526 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:00:10.766526 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:00:10.766526 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:00:10.766526 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:00:10.766526 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:00:10.766526 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:00:10.766526 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:00:10.766526 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:00:10.767452 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:00:10.767452 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:00:10.767452 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:00:10.767452 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:00:10.767452 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:00:10.767452 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:00:10.767452 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:00:10.767452 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:00:10.767452 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:00:10.767452 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:00:10.767452 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:00:10.767452 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:00:10.767452 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:00:10.767452 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:00:10.767452 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:00:10.767452 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:00:10.768200 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:00:10.768200 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:00:10.768200 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:00:10.768200 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:00:10.768200 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:00:10.768200 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:00:10.768200 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:00:10.768200 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:00:10.768200 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:00:10.768200 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:00:10.768200 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:00:10.768200 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:00:10.768200 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 58/118] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Aug 24 04:00:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:00:10.768864 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2baba84-eca6-465c-9468-c617f7d60189 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:10.792980 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:10.839165 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c041c41-502d-4b5f-bc80-10565d74e4f8 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:10.876641 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2baba84-eca6-465c-9468-c617f7d60189 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:10.879486 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa0edb-3248-49b5-ad5d-1a0694e07f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:10.880095 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa0edb-3248-49b5-ad5d-1a0694e07f63 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:10.880384 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa0edb-3248-49b5-ad5d-1a0694e07f63 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:10.880647 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa0edb-3248-49b5-ad5d-1a0694e07f63 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:10.881321 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa0edb-3248-49b5-ad5d-1a0694e07f63 None admin] RBAC: Adding query filter params (name=member) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:10.881631 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa0edb-3248-49b5-ad5d-1a0694e07f63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:10.883043 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa0edb-3248-49b5-ad5d-1a0694e07f63 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:10.893429 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 61/119] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 24 04:00:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:10.898827 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa0edb-3248-49b5-ad5d-1a0694e07f63 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:10.916408 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f0b80-810e-4d5a-a2c7-3182267ba2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:10.917024 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f0b80-810e-4d5a-a2c7-3182267ba2fe None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:10.917309 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f0b80-810e-4d5a-a2c7-3182267ba2fe None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:10.917583 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f0b80-810e-4d5a-a2c7-3182267ba2fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:10.918353 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f0b80-810e-4d5a-a2c7-3182267ba2fe None admin] RBAC: Adding query filter params (role.id=63bae148a6d14d6ca8cb30fca2851df5, scope.project.id=b8831e7463bf44df920eb14d1ccf1502, user.id=e175ccc6442840e5bacc0d9965ecb103) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:10.918662 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f0b80-810e-4d5a-a2c7-3182267ba2fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:10.920185 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5f0b80-810e-4d5a-a2c7-3182267ba2fe None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:10.925733 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 59/120] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 24 04:00:10 2022] GET /identity/v3/role_assignments?user.id=e175ccc6442840e5bacc0d9965ecb103&scope.project.id=b8831e7463bf44df920eb14d1ccf1502&role.id=63bae148a6d14d6ca8cb30fca2851df5 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:10.926533 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f0b80-810e-4d5a-a2c7-3182267ba2fe None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:10.940697 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:11.035356 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa0edb-3248-49b5-ad5d-1a0694e07f63 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:11.058524 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:11.076259 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3838878-cf0b-42c2-8e2d-929ffffb5562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:11.077093 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3838878-cf0b-42c2-8e2d-929ffffb5562 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:11.077587 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3838878-cf0b-42c2-8e2d-929ffffb5562 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:11.077958 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3838878-cf0b-42c2-8e2d-929ffffb5562 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:11.078262 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f0b80-810e-4d5a-a2c7-3182267ba2fe None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:11.091077 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3838878-cf0b-42c2-8e2d-929ffffb5562 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:00:11.096681 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-a3838878-cf0b-42c2-8e2d-929ffffb5562 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:00:11.096681 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:00:11.096681 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:00:11.096681 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:00:11.096681 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:00:11.096681 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:00:11.096681 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:00:11.096681 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:00:11.096681 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:00:11.096681 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:00:11.096681 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:00:11.096681 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:00:11.096681 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:00:11.096681 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:00:11.096681 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:00:11.096681 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:00:11.097603 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:00:11.097603 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:00:11.097603 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:00:11.097603 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:00:11.097603 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:00:11.097603 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:00:11.097603 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:00:11.097603 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:00:11.097603 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:00:11.097603 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:00:11.097603 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:00:11.097603 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:00:11.097603 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:00:11.097603 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:00:11.097603 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:00:11.097603 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:00:11.098361 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:00:11.098361 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:00:11.098361 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:00:11.098361 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:00:11.098361 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:00:11.098361 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:00:11.098361 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:00:11.098361 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:00:11.098361 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:00:11.098361 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:00:11.098361 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:00:11.098361 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:00:11.098361 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 62/121] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 04:00:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:00:11.098991 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3838878-cf0b-42c2-8e2d-929ffffb5562 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:11.122322 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451d266-7a1d-446e-b78e-32a39c1f7c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:11.123386 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451d266-7a1d-446e-b78e-32a39c1f7c8b None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:11.123880 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451d266-7a1d-446e-b78e-32a39c1f7c8b None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:11.124353 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451d266-7a1d-446e-b78e-32a39c1f7c8b None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:11.125254 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9451d266-7a1d-446e-b78e-32a39c1f7c8b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:11.125758 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9451d266-7a1d-446e-b78e-32a39c1f7c8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:11.130281 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9451d266-7a1d-446e-b78e-32a39c1f7c8b None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:11.144411 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 60/122] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 24 04:00:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:11.145793 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451d266-7a1d-446e-b78e-32a39c1f7c8b None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:11.232896 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:11.261699 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3838878-cf0b-42c2-8e2d-929ffffb5562 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:11.302440 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b7110b-7561-41b2-8145-de57292a886a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:11.303789 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7110b-7561-41b2-8145-de57292a886a None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:11.304697 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7110b-7561-41b2-8145-de57292a886a None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:11.305186 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7110b-7561-41b2-8145-de57292a886a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:11.319384 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b7110b-7561-41b2-8145-de57292a886a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:00:11.325732 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-19b7110b-7561-41b2-8145-de57292a886a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:00:11.325732 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:00:11.325732 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:00:11.325732 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:00:11.325732 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:00:11.325732 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:00:11.325732 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:00:11.325732 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:00:11.325732 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:00:11.325732 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:00:11.325732 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:00:11.325732 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:00:11.325732 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:00:11.325732 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:00:11.325732 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:00:11.325732 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:00:11.326651 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:00:11.326651 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:00:11.326651 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:00:11.326651 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:00:11.326651 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:00:11.326651 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:00:11.326651 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:00:11.326651 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:00:11.326651 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:00:11.326651 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:00:11.326651 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:00:11.326651 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:00:11.326651 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:00:11.326651 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:00:11.326651 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:00:11.326651 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:00:11.327472 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:00:11.327472 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:00:11.327472 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:00:11.327472 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:00:11.327472 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:00:11.327472 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:00:11.327472 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:00:11.327472 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:00:11.327472 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:00:11.327472 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:00:11.327472 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:00:11.327472 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:00:11.328069 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451d266-7a1d-446e-b78e-32a39c1f7c8b None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:11.330119 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 63/123] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 24 04:00:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:00:11.331217 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b7110b-7561-41b2-8145-de57292a886a None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:11.381390 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:11.412672 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a2fb7b-2c9d-43b6-b356-ec4ecad618d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:11.413382 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2fb7b-2c9d-43b6-b356-ec4ecad618d9 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:11.413670 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2fb7b-2c9d-43b6-b356-ec4ecad618d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:11.417776 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2fb7b-2c9d-43b6-b356-ec4ecad618d9 None admin] PATH_INFO: `/v3/users/fd730780576745e9955cd5f707848429` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:11.419999 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a2fb7b-2c9d-43b6-b356-ec4ecad618d9 None admin] RBAC: Authorizing `identity:get_user(user_id=fd730780576745e9955cd5f707848429)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:11.426627 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a2fb7b-2c9d-43b6-b356-ec4ecad618d9 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:11.431817 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 61/124] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 24 04:00:11 2022] GET /identity/v3/users/fd730780576745e9955cd5f707848429 => generated 275 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:11.432610 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a2fb7b-2c9d-43b6-b356-ec4ecad618d9 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:11.465756 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b7110b-7561-41b2-8145-de57292a886a None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:11.509245 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e8df6-0a90-4dd7-8836-2374fb7e4401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:11.511092 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e8df6-0a90-4dd7-8836-2374fb7e4401 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:11.511609 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e8df6-0a90-4dd7-8836-2374fb7e4401 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:11.512104 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e8df6-0a90-4dd7-8836-2374fb7e4401 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:11.512985 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e8df6-0a90-4dd7-8836-2374fb7e4401 None admin] RBAC: Adding query filter params (name=member) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:11.513492 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e8df6-0a90-4dd7-8836-2374fb7e4401 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:11.515131 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e8df6-0a90-4dd7-8836-2374fb7e4401 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:11.525012 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 64/125] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 24 04:00:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:11.526268 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e8df6-0a90-4dd7-8836-2374fb7e4401 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:11.644982 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e8df6-0a90-4dd7-8836-2374fb7e4401 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:11.648117 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:11.688802 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d7ad7-72a7-454c-9df1-89759596f192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:11.689942 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d7ad7-72a7-454c-9df1-89759596f192 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:11.690443 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d7ad7-72a7-454c-9df1-89759596f192 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:11.690922 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d7ad7-72a7-454c-9df1-89759596f192 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:11.691831 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d7ad7-72a7-454c-9df1-89759596f192 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:11.692337 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d7ad7-72a7-454c-9df1-89759596f192 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:11.694123 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d7ad7-72a7-454c-9df1-89759596f192 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:11.700224 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a2fb7b-2c9d-43b6-b356-ec4ecad618d9 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:11.705149 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 65/126] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 04:00:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:11.706246 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d7ad7-72a7-454c-9df1-89759596f192 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:11.752361 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664aa777-aad0-4edf-8d19-59d085c7f8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:11.753210 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664aa777-aad0-4edf-8d19-59d085c7f8b6 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:11.753583 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664aa777-aad0-4edf-8d19-59d085c7f8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:11.753938 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664aa777-aad0-4edf-8d19-59d085c7f8b6 None admin] PATH_INFO: `/v3/users/fd730780576745e9955cd5f707848429` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:11.755916 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664aa777-aad0-4edf-8d19-59d085c7f8b6 None admin] RBAC: Authorizing `identity:get_user(user_id=fd730780576745e9955cd5f707848429)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:11.758098 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664aa777-aad0-4edf-8d19-59d085c7f8b6 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:11.760159 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 62/127] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 24 04:00:11 2022] GET /identity/v3/users/fd730780576745e9955cd5f707848429 => generated 275 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:11.761035 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664aa777-aad0-4edf-8d19-59d085c7f8b6 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:11.764075 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:11.840208 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d7ad7-72a7-454c-9df1-89759596f192 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:11.878049 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47abb6bb-05dd-47a9-942d-8e3c34704dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:11.878694 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abb6bb-05dd-47a9-942d-8e3c34704dbe None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:11.878973 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abb6bb-05dd-47a9-942d-8e3c34704dbe None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:11.879271 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abb6bb-05dd-47a9-942d-8e3c34704dbe None admin] PATH_INFO: `/v3/projects/b8831e7463bf44df920eb14d1ccf1502` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:11.880493 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47abb6bb-05dd-47a9-942d-8e3c34704dbe None admin] RBAC: Authorizing `identity:get_project(project_id=b8831e7463bf44df920eb14d1ccf1502)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:11.881273 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664aa777-aad0-4edf-8d19-59d085c7f8b6 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:11.881958 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47abb6bb-05dd-47a9-942d-8e3c34704dbe None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:11.888531 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 66/128] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 24 04:00:11 2022] GET /identity/v3/projects/b8831e7463bf44df920eb14d1ccf1502 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:11.888531 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47abb6bb-05dd-47a9-942d-8e3c34704dbe None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:11.930630 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:11.931158 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd5fe9-d4fc-4970-8469-4338c11e1de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:11.932485 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd5fe9-d4fc-4970-8469-4338c11e1de6 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:11.932945 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd5fe9-d4fc-4970-8469-4338c11e1de6 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:11.933522 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd5fe9-d4fc-4970-8469-4338c11e1de6 None admin] PATH_INFO: `/v3/users/fd730780576745e9955cd5f707848429` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:11.935005 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd5fe9-d4fc-4970-8469-4338c11e1de6 None admin] RBAC: Authorizing `identity:get_user(user_id=fd730780576745e9955cd5f707848429)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:11.936716 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd5fe9-d4fc-4970-8469-4338c11e1de6 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:11.939939 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 63/129] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 24 04:00:11 2022] GET /identity/v3/users/fd730780576745e9955cd5f707848429 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:11.940807 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd5fe9-d4fc-4970-8469-4338c11e1de6 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:12.027825 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47abb6bb-05dd-47a9-942d-8e3c34704dbe None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:12.036299 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:12.074682 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e630295a-cba4-4be6-a77c-93ec95d7aecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:12.076018 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630295a-cba4-4be6-a77c-93ec95d7aecd None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:12.076623 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630295a-cba4-4be6-a77c-93ec95d7aecd None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:12.077383 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630295a-cba4-4be6-a77c-93ec95d7aecd None admin] PATH_INFO: `/v3/users/c414fa8ffb744c22a2619f1ccb5b8577` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:12.078795 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e630295a-cba4-4be6-a77c-93ec95d7aecd None admin] RBAC: Authorizing `identity:get_user(user_id=c414fa8ffb744c22a2619f1ccb5b8577)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:12.079505 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd5fe9-d4fc-4970-8469-4338c11e1de6 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:12.080658 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e630295a-cba4-4be6-a77c-93ec95d7aecd None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:12.083642 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 67/130] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 24 04:00:11 2022] GET /identity/v3/users/c414fa8ffb744c22a2619f1ccb5b8577 => generated 247 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:12.084465 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e630295a-cba4-4be6-a77c-93ec95d7aecd None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:12.128217 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bdb63d-3eff-4dd9-804c-cb65057bed43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:12.129002 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdb63d-3eff-4dd9-804c-cb65057bed43 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:12.129286 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdb63d-3eff-4dd9-804c-cb65057bed43 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:12.129561 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bdb63d-3eff-4dd9-804c-cb65057bed43 None admin] PATH_INFO: `/v3/projects/b8831e7463bf44df920eb14d1ccf1502` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:12.131399 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bdb63d-3eff-4dd9-804c-cb65057bed43 None admin] RBAC: Authorizing `identity:get_project(project_id=b8831e7463bf44df920eb14d1ccf1502)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:12.132945 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bdb63d-3eff-4dd9-804c-cb65057bed43 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:12.135515 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 64/131] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 24 04:00:11 2022] GET /identity/v3/projects/b8831e7463bf44df920eb14d1ccf1502 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:12.140622 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bdb63d-3eff-4dd9-804c-cb65057bed43 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:12.217196 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:12.223550 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e630295a-cba4-4be6-a77c-93ec95d7aecd None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:12.268453 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137beeb3-130a-4114-877b-b0bd606796fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:12.269757 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137beeb3-130a-4114-877b-b0bd606796fa None admin] REQUEST_METHOD: `PUT` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:12.270592 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137beeb3-130a-4114-877b-b0bd606796fa None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:12.271343 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137beeb3-130a-4114-877b-b0bd606796fa None admin] PATH_INFO: `/v3/projects/b8831e7463bf44df920eb14d1ccf1502/users/fd730780576745e9955cd5f707848429/roles/5d03284e31284f60bcc99e4843279067` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:12.273335 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bdb63d-3eff-4dd9-804c-cb65057bed43 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:12.273925 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137beeb3-130a-4114-877b-b0bd606796fa None admin] RBAC: Authorizing `identity:create_grant(project_id=b8831e7463bf44df920eb14d1ccf1502, user_id=fd730780576745e9955cd5f707848429, role_id=5d03284e31284f60bcc99e4843279067)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:12.276047 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137beeb3-130a-4114-877b-b0bd606796fa None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:12.307732 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 68/132] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Aug 24 04:00:12 2022] PUT /identity/v3/projects/b8831e7463bf44df920eb14d1ccf1502/users/fd730780576745e9955cd5f707848429/roles/5d03284e31284f60bcc99e4843279067 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:00:12.310514 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137beeb3-130a-4114-877b-b0bd606796fa None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:12.314545 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8f0ba-19a1-43de-9c47-218d1d2e77ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:12.315411 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8f0ba-19a1-43de-9c47-218d1d2e77ed None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:12.315753 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8f0ba-19a1-43de-9c47-218d1d2e77ed None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:12.316081 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8f0ba-19a1-43de-9c47-218d1d2e77ed None admin] PATH_INFO: `/v3/projects/d48fb0f516b742648ed34ee191ac5dd8` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:12.317687 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a8f0ba-19a1-43de-9c47-218d1d2e77ed None admin] RBAC: Authorizing `identity:get_project(project_id=d48fb0f516b742648ed34ee191ac5dd8)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:12.319214 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a8f0ba-19a1-43de-9c47-218d1d2e77ed None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:12.321831 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 65/133] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 24 04:00:12 2022] GET /identity/v3/projects/d48fb0f516b742648ed34ee191ac5dd8 => generated 312 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:12.327642 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8f0ba-19a1-43de-9c47-218d1d2e77ed None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:12.338783 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:12.469092 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8f0ba-19a1-43de-9c47-218d1d2e77ed None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:12.493844 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137beeb3-130a-4114-877b-b0bd606796fa None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:12.527798 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912234ab-bd3a-4049-ab45-547c3f948b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:12.529370 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912234ab-bd3a-4049-ab45-547c3f948b79 None admin] REQUEST_METHOD: `PUT` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:12.529701 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912234ab-bd3a-4049-ab45-547c3f948b79 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:12.530105 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912234ab-bd3a-4049-ab45-547c3f948b79 None admin] PATH_INFO: `/v3/projects/b8831e7463bf44df920eb14d1ccf1502/users/fd730780576745e9955cd5f707848429/roles/a9f3803644ca4a6fab51b9513141be7b` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:12.534036 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912234ab-bd3a-4049-ab45-547c3f948b79 None admin] RBAC: Authorizing `identity:create_grant(project_id=b8831e7463bf44df920eb14d1ccf1502, user_id=fd730780576745e9955cd5f707848429, role_id=a9f3803644ca4a6fab51b9513141be7b)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:12.537102 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912234ab-bd3a-4049-ab45-547c3f948b79 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:12.544645 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dcaba8-757d-4a84-868c-a7d954407768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:12.547079 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dcaba8-757d-4a84-868c-a7d954407768 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:12.547643 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dcaba8-757d-4a84-868c-a7d954407768 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:12.548107 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dcaba8-757d-4a84-868c-a7d954407768 None admin] PATH_INFO: `/v3/projects/b8831e7463bf44df920eb14d1ccf1502` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:12.553715 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dcaba8-757d-4a84-868c-a7d954407768 None admin] RBAC: Authorizing `identity:get_project(project_id=b8831e7463bf44df920eb14d1ccf1502)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:12.557426 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dcaba8-757d-4a84-868c-a7d954407768 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:12.560142 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 69/134] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 24 04:00:12 2022] GET /identity/v3/projects/b8831e7463bf44df920eb14d1ccf1502 => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:12.561024 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dcaba8-757d-4a84-868c-a7d954407768 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:12.562124 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 66/135] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Aug 24 04:00:12 2022] PUT /identity/v3/projects/b8831e7463bf44df920eb14d1ccf1502/users/fd730780576745e9955cd5f707848429/roles/a9f3803644ca4a6fab51b9513141be7b => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:00:12.571835 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912234ab-bd3a-4049-ab45-547c3f948b79 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:12.648243 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:12.708026 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:12.774199 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912234ab-bd3a-4049-ab45-547c3f948b79 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:12.795709 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dcaba8-757d-4a84-868c-a7d954407768 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:12.840480 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae4211-f777-46ef-b329-181d1e68c65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:12.842321 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae4211-f777-46ef-b329-181d1e68c65a None admin] REQUEST_METHOD: `PUT` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:12.843237 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae4211-f777-46ef-b329-181d1e68c65a None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:12.843417 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945396d-8e77-43f4-b06e-40e8d7b3cd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:12.844083 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945396d-8e77-43f4-b06e-40e8d7b3cd9a None admin] REQUEST_METHOD: `PUT` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:12.844364 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945396d-8e77-43f4-b06e-40e8d7b3cd9a None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:12.844637 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945396d-8e77-43f4-b06e-40e8d7b3cd9a None admin] PATH_INFO: `/v3/projects/d48fb0f516b742648ed34ee191ac5dd8/users/fd730780576745e9955cd5f707848429/roles/5d03284e31284f60bcc99e4843279067` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:12.844986 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae4211-f777-46ef-b329-181d1e68c65a None admin] PATH_INFO: `/v3/projects/b8831e7463bf44df920eb14d1ccf1502/users/c414fa8ffb744c22a2619f1ccb5b8577/roles/df6a8bb215d54f71a0b6988a9c01f5e4` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:12.846729 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4945396d-8e77-43f4-b06e-40e8d7b3cd9a None admin] RBAC: Authorizing `identity:create_grant(project_id=d48fb0f516b742648ed34ee191ac5dd8, user_id=fd730780576745e9955cd5f707848429, role_id=5d03284e31284f60bcc99e4843279067)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:12.848485 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4945396d-8e77-43f4-b06e-40e8d7b3cd9a None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:12.848916 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbae4211-f777-46ef-b329-181d1e68c65a None admin] RBAC: Authorizing `identity:create_grant(project_id=b8831e7463bf44df920eb14d1ccf1502, user_id=c414fa8ffb744c22a2619f1ccb5b8577, role_id=df6a8bb215d54f71a0b6988a9c01f5e4)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:12.853431 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbae4211-f777-46ef-b329-181d1e68c65a None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:12.875212 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 67/136] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Aug 24 04:00:12 2022] PUT /identity/v3/projects/b8831e7463bf44df920eb14d1ccf1502/users/c414fa8ffb744c22a2619f1ccb5b8577/roles/df6a8bb215d54f71a0b6988a9c01f5e4 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:00:12.876544 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 70/137] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Aug 24 04:00:12 2022] PUT /identity/v3/projects/d48fb0f516b742648ed34ee191ac5dd8/users/fd730780576745e9955cd5f707848429/roles/5d03284e31284f60bcc99e4843279067 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:00:12.878024 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57782a18-9be0-4e1b-b45e-492de350cc96 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:12.878594 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57782a18-9be0-4e1b-b45e-492de350cc96 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:12.879149 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57782a18-9be0-4e1b-b45e-492de350cc96 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:12.881982 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 68/138] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:00:12.888315 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5913e45-bdbb-4d58-9433-be5ff5708c82 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:12.888652 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5913e45-bdbb-4d58-9433-be5ff5708c82 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:12.888887 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5913e45-bdbb-4d58-9433-be5ff5708c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:12.926480 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-e5913e45-bdbb-4d58-9433-be5ff5708c82 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:12.930333 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-e5913e45-bdbb-4d58-9433-be5ff5708c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:13.033568 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 71/139] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:00:13.398951 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57782a18-9be0-4e1b-b45e-492de350cc96 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:13.476500 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1a631-5959-4481-bf81-e9fccdcdf58c None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:13.476820 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1a631-5959-4481-bf81-e9fccdcdf58c None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:13.477057 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1a631-5959-4481-bf81-e9fccdcdf58c None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:13.478477 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 72/140] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:00:13.484673 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd324339-72b9-41a9-ad48-50e15c9aa704 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:13.484962 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd324339-72b9-41a9-ad48-50e15c9aa704 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:13.485238 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd324339-72b9-41a9-ad48-50e15c9aa704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:13.514905 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-cd324339-72b9-41a9-ad48-50e15c9aa704 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:13.521776 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-cd324339-72b9-41a9-ad48-50e15c9aa704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:13.551086 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:13.580719 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57782a18-9be0-4e1b-b45e-492de350cc96 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:13.632548 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 73/141] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:00:13.650958 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:13.669701 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cf208-1493-420a-bb3c-b1260c0f877c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:13.670335 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cf208-1493-420a-bb3c-b1260c0f877c None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:13.670614 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cf208-1493-420a-bb3c-b1260c0f877c None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:13.670885 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8cf208-1493-420a-bb3c-b1260c0f877c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:13.672627 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8cf208-1493-420a-bb3c-b1260c0f877c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:13.674073 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8cf208-1493-420a-bb3c-b1260c0f877c None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:13.675976 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 69/142] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:00:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:13.681756 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd324339-72b9-41a9-ad48-50e15c9aa704 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:13.825979 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd324339-72b9-41a9-ad48-50e15c9aa704 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:13.876478 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb430a32-c91a-48a1-bc1b-759d60bc642f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:13.877098 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb430a32-c91a-48a1-bc1b-759d60bc642f None admin] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:13.877372 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb430a32-c91a-48a1-bc1b-759d60bc642f None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:13.877641 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb430a32-c91a-48a1-bc1b-759d60bc642f None admin] PATH_INFO: `/v3/users` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:13.878299 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb430a32-c91a-48a1-bc1b-759d60bc642f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:13.879809 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb430a32-c91a-48a1-bc1b-759d60bc642f None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:13.908873 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 74/143] 10.222.0.15 () {60 vars in 1132 bytes} [Wed Aug 24 04:00:13 2022] POST /identity/v3/users => generated 283 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:00:14.164206 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cf208-1493-420a-bb3c-b1260c0f877c None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:14.278706 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8cf208-1493-420a-bb3c-b1260c0f877c None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:14.314384 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d46c8c-cf4b-4044-98a3-bc8b4b86529b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:14.315018 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d46c8c-cf4b-4044-98a3-bc8b4b86529b None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:14.315324 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d46c8c-cf4b-4044-98a3-bc8b4b86529b None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:14.315621 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d46c8c-cf4b-4044-98a3-bc8b4b86529b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:14.327142 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d46c8c-cf4b-4044-98a3-bc8b4b86529b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:00:14.332429 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-77d46c8c-cf4b-4044-98a3-bc8b4b86529b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:00:14.332429 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:00:14.332429 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:00:14.332429 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:00:14.332429 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:00:14.332429 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:00:14.332429 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:00:14.332429 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:00:14.332429 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:00:14.332429 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:00:14.332429 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:00:14.332429 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:00:14.332429 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:00:14.332429 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:00:14.332429 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:00:14.332429 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:00:14.333283 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:00:14.333283 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:00:14.333283 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:00:14.333283 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:00:14.333283 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:00:14.333283 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:00:14.333283 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:00:14.333283 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:00:14.333283 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:00:14.333283 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:00:14.333283 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:00:14.333283 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:00:14.333283 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:00:14.333283 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:00:14.333283 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:00:14.333283 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:00:14.334432 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:00:14.334432 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:00:14.334432 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:00:14.334432 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:00:14.334432 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:00:14.334432 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:00:14.334432 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:00:14.334432 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:00:14.334432 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:00:14.334432 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:00:14.334432 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:00:14.334432 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:00:14.334432 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 70/144] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 04:00:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:00:14.339926 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb430a32-c91a-48a1-bc1b-759d60bc642f None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:14.344014 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:14.447288 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb430a32-c91a-48a1-bc1b-759d60bc642f None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:14.483774 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b3ac1-503a-4f61-92a8-dfb2bf538ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:14.484398 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b3ac1-503a-4f61-92a8-dfb2bf538ace None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:14.484670 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b3ac1-503a-4f61-92a8-dfb2bf538ace None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:14.484937 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b3ac1-503a-4f61-92a8-dfb2bf538ace None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:14.485611 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44b3ac1-503a-4f61-92a8-dfb2bf538ace None admin] RBAC: Adding query filter params (name=reader) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:14.485951 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44b3ac1-503a-4f61-92a8-dfb2bf538ace None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:14.487391 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44b3ac1-503a-4f61-92a8-dfb2bf538ace None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:14.497653 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 75/145] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 24 04:00:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:14.503432 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d46c8c-cf4b-4044-98a3-bc8b4b86529b None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:14.581536 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:14.660997 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d46c8c-cf4b-4044-98a3-bc8b4b86529b None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:14.729146 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82482ab5-787c-4054-b665-d56455975318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:14.730096 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82482ab5-787c-4054-b665-d56455975318 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:14.730798 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82482ab5-787c-4054-b665-d56455975318 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:14.731298 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82482ab5-787c-4054-b665-d56455975318 None admin] PATH_INFO: `/v3/users/e175ccc6442840e5bacc0d9965ecb103` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:14.735832 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82482ab5-787c-4054-b665-d56455975318 None admin] RBAC: Authorizing `identity:get_user(user_id=e175ccc6442840e5bacc0d9965ecb103)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:14.738468 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82482ab5-787c-4054-b665-d56455975318 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:14.741802 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 71/146] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 24 04:00:14 2022] GET /identity/v3/users/e175ccc6442840e5bacc0d9965ecb103 => generated 289 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:14.751809 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b3ac1-503a-4f61-92a8-dfb2bf538ace None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:14.872404 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:14.935061 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b3ac1-503a-4f61-92a8-dfb2bf538ace None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:15.000054 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05434a-6435-443d-815d-71f680baaeff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:15.000960 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05434a-6435-443d-815d-71f680baaeff None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:15.001430 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05434a-6435-443d-815d-71f680baaeff None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:15.001897 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05434a-6435-443d-815d-71f680baaeff None admin] PATH_INFO: `/v3/projects/b8831e7463bf44df920eb14d1ccf1502` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:15.004127 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb05434a-6435-443d-815d-71f680baaeff None admin] RBAC: Authorizing `identity:get_project(project_id=b8831e7463bf44df920eb14d1ccf1502)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:15.006632 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb05434a-6435-443d-815d-71f680baaeff None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:15.009686 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 76/147] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 24 04:00:14 2022] GET /identity/v3/projects/b8831e7463bf44df920eb14d1ccf1502 => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:15.018976 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82482ab5-787c-4054-b665-d56455975318 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:15.205058 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82482ab5-787c-4054-b665-d56455975318 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:15.247624 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:15.270358 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec921ea3-7082-41dc-ab38-7db17de1b838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:15.271396 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec921ea3-7082-41dc-ab38-7db17de1b838 None admin] REQUEST_METHOD: `PUT` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:15.271867 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec921ea3-7082-41dc-ab38-7db17de1b838 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:15.272405 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec921ea3-7082-41dc-ab38-7db17de1b838 None admin] PATH_INFO: `/v3/projects/b8831e7463bf44df920eb14d1ccf1502/users/e175ccc6442840e5bacc0d9965ecb103/roles/63bae148a6d14d6ca8cb30fca2851df5` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:15.281407 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec921ea3-7082-41dc-ab38-7db17de1b838 None admin] RBAC: Authorizing `identity:create_grant(project_id=b8831e7463bf44df920eb14d1ccf1502, user_id=e175ccc6442840e5bacc0d9965ecb103, role_id=63bae148a6d14d6ca8cb30fca2851df5)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:15.284116 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec921ea3-7082-41dc-ab38-7db17de1b838 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:15.306638 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 72/148] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Aug 24 04:00:15 2022] PUT /identity/v3/projects/b8831e7463bf44df920eb14d1ccf1502/users/e175ccc6442840e5bacc0d9965ecb103/roles/63bae148a6d14d6ca8cb30fca2851df5 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:00:15.345101 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee17861-d9a7-42a8-9c6d-6664cfe68f1f None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:15.345440 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee17861-d9a7-42a8-9c6d-6664cfe68f1f None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:15.345724 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee17861-d9a7-42a8-9c6d-6664cfe68f1f None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:15.347442 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 77/149] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:00:15.353165 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1536ea-f699-4640-8195-af9b82ed0b8e None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:15.353510 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1536ea-f699-4640-8195-af9b82ed0b8e None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:15.353818 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1536ea-f699-4640-8195-af9b82ed0b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:15.388577 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-0e1536ea-f699-4640-8195-af9b82ed0b8e None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:15.389915 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-0e1536ea-f699-4640-8195-af9b82ed0b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:15.503686 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 73/150] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:00:15.894477 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee17861-d9a7-42a8-9c6d-6664cfe68f1f None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:16.109061 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee17861-d9a7-42a8-9c6d-6664cfe68f1f None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:16.171295 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1add254-b288-49b8-87e3-ea98f46705d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:16.172226 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1add254-b288-49b8-87e3-ea98f46705d8 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:16.172691 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1add254-b288-49b8-87e3-ea98f46705d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:16.173204 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1add254-b288-49b8-87e3-ea98f46705d8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:16.176911 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:16.198312 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1add254-b288-49b8-87e3-ea98f46705d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:00:16.210617 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-e1add254-b288-49b8-87e3-ea98f46705d8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:00:16.210617 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:00:16.210617 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:00:16.210617 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:00:16.210617 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:00:16.210617 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:00:16.210617 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:00:16.210617 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:00:16.210617 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:00:16.210617 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:00:16.210617 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:00:16.210617 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:00:16.210617 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:00:16.210617 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:00:16.210617 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:00:16.210617 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:00:16.212305 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:00:16.212305 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:00:16.212305 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:00:16.212305 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:00:16.212305 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:00:16.212305 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:00:16.212305 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:00:16.212305 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:00:16.212305 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:00:16.212305 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:00:16.212305 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:00:16.212305 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:00:16.212305 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:00:16.212305 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:00:16.212305 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:00:16.212305 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:00:16.213738 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:00:16.213738 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:00:16.213738 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:00:16.213738 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:00:16.213738 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:00:16.213738 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:00:16.213738 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:00:16.213738 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:00:16.213738 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:00:16.213738 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:00:16.213738 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:00:16.213738 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:00:16.213738 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 78/151] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 04:00:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:00:16.219693 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1536ea-f699-4640-8195-af9b82ed0b8e None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:16.408285 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1536ea-f699-4640-8195-af9b82ed0b8e None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:16.442142 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:16.493594 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066781d9-b3a8-4093-b2ef-c326cd71a608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:16.494591 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066781d9-b3a8-4093-b2ef-c326cd71a608 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:16.495072 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066781d9-b3a8-4093-b2ef-c326cd71a608 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:16.495570 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066781d9-b3a8-4093-b2ef-c326cd71a608 None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:16.496749 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066781d9-b3a8-4093-b2ef-c326cd71a608 None admin] RBAC: Adding query filter params (name=member) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:16.497278 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066781d9-b3a8-4093-b2ef-c326cd71a608 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:16.499858 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066781d9-b3a8-4093-b2ef-c326cd71a608 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:16.511439 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 74/152] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 24 04:00:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:16.520703 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1add254-b288-49b8-87e3-ea98f46705d8 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:16.752876 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af77f1-4fa0-49b4-9e79-e820e7d77f4b None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:16.753099 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af77f1-4fa0-49b4-9e79-e820e7d77f4b None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:16.753496 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af77f1-4fa0-49b4-9e79-e820e7d77f4b None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:16.754669 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 75/153] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:00:16.764676 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d6fb5-dad4-48cb-ab4c-d9e89a2840b6 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:16.765078 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d6fb5-dad4-48cb-ab4c-d9e89a2840b6 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:16.765224 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d6fb5-dad4-48cb-ab4c-d9e89a2840b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:16.769329 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1add254-b288-49b8-87e3-ea98f46705d8 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:16.800243 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-786d6fb5-dad4-48cb-ab4c-d9e89a2840b6 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:16.801880 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-786d6fb5-dad4-48cb-ab4c-d9e89a2840b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:16.869855 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edaaa4b-5213-47c7-a359-9bd2b702092d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:16.871272 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edaaa4b-5213-47c7-a359-9bd2b702092d None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:16.871961 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edaaa4b-5213-47c7-a359-9bd2b702092d None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:16.872626 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edaaa4b-5213-47c7-a359-9bd2b702092d None admin] PATH_INFO: `/v3/users/fd730780576745e9955cd5f707848429` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:16.876468 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edaaa4b-5213-47c7-a359-9bd2b702092d None admin] RBAC: Authorizing `identity:get_user(user_id=fd730780576745e9955cd5f707848429)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:16.879688 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edaaa4b-5213-47c7-a359-9bd2b702092d None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:16.883140 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 79/154] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 24 04:00:16 2022] GET /identity/v3/users/fd730780576745e9955cd5f707848429 => generated 275 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:16.889310 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edaaa4b-5213-47c7-a359-9bd2b702092d None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:16.915806 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 76/155] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:00:17.069549 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:17.078010 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63049a-c446-40e7-9569-20994a9dd426 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:17.078319 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63049a-c446-40e7-9569-20994a9dd426 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:17.078539 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63049a-c446-40e7-9569-20994a9dd426 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:17.080083 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 77/156] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:00:17.098339 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b0063-af87-4f88-8d11-38493cd3fdb3 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:17.098652 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b0063-af87-4f88-8d11-38493cd3fdb3 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:17.098890 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b0063-af87-4f88-8d11-38493cd3fdb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:17.129010 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-8d7b0063-af87-4f88-8d11-38493cd3fdb3 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:17.130240 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-8d7b0063-af87-4f88-8d11-38493cd3fdb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:17.130773 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edaaa4b-5213-47c7-a359-9bd2b702092d None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:17.211550 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f2ecec-7deb-453d-b1b6-3ad1a0fa55fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:17.212214 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2ecec-7deb-453d-b1b6-3ad1a0fa55fc None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:17.212488 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2ecec-7deb-453d-b1b6-3ad1a0fa55fc None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:17.212754 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2ecec-7deb-453d-b1b6-3ad1a0fa55fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:17.255587 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 78/157] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:00:17.345053 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f2ecec-7deb-453d-b1b6-3ad1a0fa55fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:17.346544 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f2ecec-7deb-453d-b1b6-3ad1a0fa55fc None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:17.428071 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:17.476174 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 80/158] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 24 04:00:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:17.482175 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b0063-af87-4f88-8d11-38493cd3fdb3 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:17.530215 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:17.608947 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b0063-af87-4f88-8d11-38493cd3fdb3 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:17.638076 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f2ecec-7deb-453d-b1b6-3ad1a0fa55fc None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:17.646208 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6080585-30a8-4847-b56b-06710e994de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:17.646857 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6080585-30a8-4847-b56b-06710e994de2 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:17.647219 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6080585-30a8-4847-b56b-06710e994de2 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:17.647499 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6080585-30a8-4847-b56b-06710e994de2 None admin] PATH_INFO: `/v3/projects/b8831e7463bf44df920eb14d1ccf1502` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:17.649701 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6080585-30a8-4847-b56b-06710e994de2 None admin] RBAC: Authorizing `identity:get_project(project_id=b8831e7463bf44df920eb14d1ccf1502)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:17.651167 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6080585-30a8-4847-b56b-06710e994de2 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:17.652936 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 79/159] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 24 04:00:17 2022] GET /identity/v3/projects/b8831e7463bf44df920eb14d1ccf1502 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:17.659769 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6080585-30a8-4847-b56b-06710e994de2 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:17.775715 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6080585-30a8-4847-b56b-06710e994de2 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:17.777778 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:17.816413 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f130c-829d-4326-8064-f3dd5c3c3b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:17.817022 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f130c-829d-4326-8064-f3dd5c3c3b56 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:17.817299 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f130c-829d-4326-8064-f3dd5c3c3b56 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:17.817570 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f130c-829d-4326-8064-f3dd5c3c3b56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:17.818791 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f130c-829d-4326-8064-f3dd5c3c3b56 None admin] RBAC: Adding query filter params (role.id=5d03284e31284f60bcc99e4843279067, scope.project.id=b8831e7463bf44df920eb14d1ccf1502, user.id=fd730780576745e9955cd5f707848429) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:17.819115 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f130c-829d-4326-8064-f3dd5c3c3b56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:17.821257 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f130c-829d-4326-8064-f3dd5c3c3b56 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:17.828382 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 80/160] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 24 04:00:17 2022] GET /identity/v3/role_assignments?user.id=fd730780576745e9955cd5f707848429&scope.project.id=b8831e7463bf44df920eb14d1ccf1502&role.id=5d03284e31284f60bcc99e4843279067 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:17.877373 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f2ecec-7deb-453d-b1b6-3ad1a0fa55fc None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:17.953616 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a9064-1703-44f7-900e-8953815a27ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:17.954278 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a9064-1703-44f7-900e-8953815a27ac None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:17.954552 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a9064-1703-44f7-900e-8953815a27ac None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:17.954822 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a9064-1703-44f7-900e-8953815a27ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:17.973385 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a9064-1703-44f7-900e-8953815a27ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:00:17.978697 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-bf6a9064-1703-44f7-900e-8953815a27ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:00:17.978697 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:00:17.978697 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:00:17.978697 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:00:17.978697 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:00:17.978697 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:00:17.978697 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:00:17.978697 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:00:17.978697 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:00:17.978697 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:00:17.978697 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:00:17.978697 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:00:17.978697 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:00:17.978697 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:00:17.978697 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:00:17.978697 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:00:17.979663 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:00:17.979663 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:00:17.979663 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:00:17.979663 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:00:17.979663 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:00:17.979663 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:00:17.979663 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:00:17.979663 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:00:17.979663 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:00:17.979663 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:00:17.979663 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:00:17.979663 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:00:17.979663 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:00:17.979663 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:00:17.979663 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:00:17.979663 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:00:17.980864 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:00:17.980864 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:00:17.980864 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:00:17.980864 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:00:17.980864 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:00:17.980864 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:00:17.980864 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:00:17.980864 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:00:17.980864 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:00:17.980864 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:00:17.980864 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:00:17.980864 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:00:17.980864 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 81/161] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 04:00:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:00:17.986244 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f130c-829d-4326-8064-f3dd5c3c3b56 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:18.118666 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f130c-829d-4326-8064-f3dd5c3c3b56 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:18.155399 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061c3d0-305b-46ac-87a3-64d6e5470345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:18.155937 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061c3d0-305b-46ac-87a3-64d6e5470345 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:18.156218 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061c3d0-305b-46ac-87a3-64d6e5470345 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:18.156677 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061c3d0-305b-46ac-87a3-64d6e5470345 None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:18.157569 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9061c3d0-305b-46ac-87a3-64d6e5470345 None admin] RBAC: Adding query filter params (name=member) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:18.157883 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9061c3d0-305b-46ac-87a3-64d6e5470345 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:18.159439 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9061c3d0-305b-46ac-87a3-64d6e5470345 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:18.169284 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 81/162] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 24 04:00:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:18.174637 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a9064-1703-44f7-900e-8953815a27ac None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:18.222206 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:18.243786 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955c79d-0d68-4c8e-8846-6c235e831caa None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:18.244268 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955c79d-0d68-4c8e-8846-6c235e831caa None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:18.244647 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955c79d-0d68-4c8e-8846-6c235e831caa None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:18.246737 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 82/163] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:00:18.252802 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72419849-d9f7-4073-aa47-4f0a16aad9a6 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:18.253202 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72419849-d9f7-4073-aa47-4f0a16aad9a6 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:18.253594 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72419849-d9f7-4073-aa47-4f0a16aad9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:18.284424 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-72419849-d9f7-4073-aa47-4f0a16aad9a6 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:18.286737 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-72419849-d9f7-4073-aa47-4f0a16aad9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:18.319604 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:18.372474 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 83/164] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:00:18.373546 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72419849-d9f7-4073-aa47-4f0a16aad9a6 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:18.374704 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a9064-1703-44f7-900e-8953815a27ac None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:18.508257 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b91190-e251-4666-8566-d9ed918a1901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:18.509210 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b91190-e251-4666-8566-d9ed918a1901 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:18.509697 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b91190-e251-4666-8566-d9ed918a1901 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:18.510154 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b91190-e251-4666-8566-d9ed918a1901 None admin] PATH_INFO: `/v3/users/fd730780576745e9955cd5f707848429` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:18.511931 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b91190-e251-4666-8566-d9ed918a1901 None admin] RBAC: Authorizing `identity:get_user(user_id=fd730780576745e9955cd5f707848429)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:18.513663 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b91190-e251-4666-8566-d9ed918a1901 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:18.520080 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 82/165] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 24 04:00:18 2022] GET /identity/v3/users/fd730780576745e9955cd5f707848429 => generated 275 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:18.528283 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b91190-e251-4666-8566-d9ed918a1901 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:18.556476 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72419849-d9f7-4073-aa47-4f0a16aad9a6 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:18.638650 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9655d17-4fda-4a08-b014-0096461b3db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:18.639620 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9655d17-4fda-4a08-b014-0096461b3db6 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:18.640070 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9655d17-4fda-4a08-b014-0096461b3db6 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:18.640539 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9655d17-4fda-4a08-b014-0096461b3db6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:18.667661 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9655d17-4fda-4a08-b014-0096461b3db6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:00:18.679217 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-f9655d17-4fda-4a08-b014-0096461b3db6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:00:18.679217 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:00:18.679217 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:00:18.679217 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:00:18.679217 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:00:18.679217 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:00:18.679217 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:00:18.679217 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:00:18.679217 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:00:18.679217 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:00:18.679217 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:00:18.679217 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:00:18.679217 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:00:18.679217 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:00:18.679217 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:00:18.679217 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:00:18.680155 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:00:18.680155 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:00:18.680155 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:00:18.680155 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:00:18.680155 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:00:18.680155 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:00:18.680155 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:00:18.680155 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:00:18.680155 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:00:18.680155 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:00:18.680155 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:00:18.680155 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:00:18.680155 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:00:18.680155 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:00:18.680155 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:00:18.680155 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:00:18.681054 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:00:18.681054 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:00:18.681054 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:00:18.681054 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:00:18.681054 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:00:18.681054 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:00:18.681054 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:00:18.681054 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:00:18.681054 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:00:18.681054 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:00:18.681054 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:00:18.681054 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:00:18.685212 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 84/166] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Aug 24 04:00:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:00:18.692208 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9655d17-4fda-4a08-b014-0096461b3db6 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:18.742086 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:18.769228 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:18.799464 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b91190-e251-4666-8566-d9ed918a1901 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:18.876927 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a272cd45-023e-4f93-9668-dcd660b78d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:18.877787 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272cd45-023e-4f93-9668-dcd660b78d03 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:18.878226 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272cd45-023e-4f93-9668-dcd660b78d03 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:18.878637 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272cd45-023e-4f93-9668-dcd660b78d03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:18.939219 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9655d17-4fda-4a08-b014-0096461b3db6 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:18.981298 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8bab72-f558-497c-b285-6e7b615bda0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:18.982300 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bab72-f558-497c-b285-6e7b615bda0e None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:18.982586 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bab72-f558-497c-b285-6e7b615bda0e None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:18.982857 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bab72-f558-497c-b285-6e7b615bda0e None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:18.983564 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8bab72-f558-497c-b285-6e7b615bda0e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:18.983868 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8bab72-f558-497c-b285-6e7b615bda0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:18.985442 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8bab72-f558-497c-b285-6e7b615bda0e None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:18.994397 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 85/167] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 24 04:00:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:19.000799 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8bab72-f558-497c-b285-6e7b615bda0e None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:19.046839 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a272cd45-023e-4f93-9668-dcd660b78d03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:19.048329 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a272cd45-023e-4f93-9668-dcd660b78d03 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:19.095619 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:19.145229 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8bab72-f558-497c-b285-6e7b615bda0e None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:19.175367 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:19.195908 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 83/168] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 24 04:00:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 668 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:19.196832 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a272cd45-023e-4f93-9668-dcd660b78d03 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:19.236115 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1dc7b-01a8-4d5c-86cd-2e0e8d69d445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:19.236764 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1dc7b-01a8-4d5c-86cd-2e0e8d69d445 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:19.237323 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1dc7b-01a8-4d5c-86cd-2e0e8d69d445 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:19.237592 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1dc7b-01a8-4d5c-86cd-2e0e8d69d445 None admin] PATH_INFO: `/v3/users/fd730780576745e9955cd5f707848429` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:19.239984 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1dc7b-01a8-4d5c-86cd-2e0e8d69d445 None admin] RBAC: Authorizing `identity:get_user(user_id=fd730780576745e9955cd5f707848429)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:19.241444 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1dc7b-01a8-4d5c-86cd-2e0e8d69d445 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:19.243043 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 86/169] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 24 04:00:18 2022] GET /identity/v3/users/fd730780576745e9955cd5f707848429 => generated 275 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:00:19.243889 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1dc7b-01a8-4d5c-86cd-2e0e8d69d445 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:19.419356 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a272cd45-023e-4f93-9668-dcd660b78d03 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:19.434526 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1dc7b-01a8-4d5c-86cd-2e0e8d69d445 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:19.495904 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba491b4e-2ca4-4d85-9765-85fb9f823ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:19.496558 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba491b4e-2ca4-4d85-9765-85fb9f823ba7 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:19.496831 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba491b4e-2ca4-4d85-9765-85fb9f823ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:19.497097 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba491b4e-2ca4-4d85-9765-85fb9f823ba7 None admin] PATH_INFO: `/v3/projects/d48fb0f516b742648ed34ee191ac5dd8` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:19.500094 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba491b4e-2ca4-4d85-9765-85fb9f823ba7 None admin] RBAC: Authorizing `identity:get_project(project_id=d48fb0f516b742648ed34ee191ac5dd8)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:19.501768 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba491b4e-2ca4-4d85-9765-85fb9f823ba7 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:19.503659 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 87/170] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 24 04:00:19 2022] GET /identity/v3/projects/d48fb0f516b742648ed34ee191ac5dd8 => generated 312 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:19.504685 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba491b4e-2ca4-4d85-9765-85fb9f823ba7 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:19.507908 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f0c5a1-2e61-401e-b186-528763c31775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:19.508635 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0c5a1-2e61-401e-b186-528763c31775 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:19.508994 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0c5a1-2e61-401e-b186-528763c31775 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:19.509272 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0c5a1-2e61-401e-b186-528763c31775 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:19.539568 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:19.549650 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f0c5a1-2e61-401e-b186-528763c31775 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:00:19.555223 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-86f0c5a1-2e61-401e-b186-528763c31775 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:00:19.555223 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:00:19.555223 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:00:19.555223 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:00:19.555223 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:00:19.555223 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:00:19.555223 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:00:19.555223 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:00:19.555223 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:00:19.555223 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:00:19.555223 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:00:19.555223 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:00:19.555223 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:00:19.555223 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:00:19.555223 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:00:19.555223 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:00:19.556507 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:00:19.556507 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:00:19.556507 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:00:19.556507 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:00:19.556507 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:00:19.556507 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:00:19.556507 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:00:19.556507 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:00:19.556507 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:00:19.556507 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:00:19.556507 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:00:19.556507 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:00:19.556507 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:00:19.556507 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:00:19.556507 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:00:19.556507 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:00:19.557270 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:00:19.557270 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:00:19.557270 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:00:19.557270 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:00:19.557270 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:00:19.557270 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:00:19.557270 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:00:19.557270 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:00:19.557270 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:00:19.557270 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:00:19.557270 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:00:19.557270 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:00:19.557270 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 84/171] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 24 04:00:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:00:19.557270 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f0c5a1-2e61-401e-b186-528763c31775 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:19.670760 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba491b4e-2ca4-4d85-9765-85fb9f823ba7 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:19.680323 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:19.726590 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa82d0-dd40-4bc6-8cd5-3c055245c194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:19.727685 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa82d0-dd40-4bc6-8cd5-3c055245c194 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:19.728221 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa82d0-dd40-4bc6-8cd5-3c055245c194 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:19.728697 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa82d0-dd40-4bc6-8cd5-3c055245c194 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:19.776795 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f0c5a1-2e61-401e-b186-528763c31775 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:19.845160 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3b7c8-c9f2-4e34-8f3a-43c1448fbf7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:19.846730 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3b7c8-c9f2-4e34-8f3a-43c1448fbf7c None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:19.847816 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3b7c8-c9f2-4e34-8f3a-43c1448fbf7c None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:19.848384 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3b7c8-c9f2-4e34-8f3a-43c1448fbf7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:19.850433 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca3b7c8-c9f2-4e34-8f3a-43c1448fbf7c None admin] RBAC: Adding query filter params (role.id=5d03284e31284f60bcc99e4843279067, scope.project.id=d48fb0f516b742648ed34ee191ac5dd8, user.id=fd730780576745e9955cd5f707848429) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:19.850906 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca3b7c8-c9f2-4e34-8f3a-43c1448fbf7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:19.853247 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca3b7c8-c9f2-4e34-8f3a-43c1448fbf7c None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:19.862907 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 85/172] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 24 04:00:19 2022] GET /identity/v3/role_assignments?user.id=fd730780576745e9955cd5f707848429&scope.project.id=d48fb0f516b742648ed34ee191ac5dd8&role.id=5d03284e31284f60bcc99e4843279067 => generated 608 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:19.866770 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3b7c8-c9f2-4e34-8f3a-43c1448fbf7c None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:19.871117 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa82d0-dd40-4bc6-8cd5-3c055245c194 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:19.875041 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa82d0-dd40-4bc6-8cd5-3c055245c194 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:19.915565 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:19.988984 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3b7c8-c9f2-4e34-8f3a-43c1448fbf7c None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:20.010742 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:20.042200 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97afabb-1551-4aa7-a4ab-3280e186497d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:20.042844 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97afabb-1551-4aa7-a4ab-3280e186497d None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:20.043120 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97afabb-1551-4aa7-a4ab-3280e186497d None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:20.045035 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97afabb-1551-4aa7-a4ab-3280e186497d None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:20.045775 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97afabb-1551-4aa7-a4ab-3280e186497d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:20.046078 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97afabb-1551-4aa7-a4ab-3280e186497d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:20.047565 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97afabb-1551-4aa7-a4ab-3280e186497d None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:20.058031 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 86/173] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 04:00:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:20.059426 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e77d5-3dae-474e-86e0-ea589995d158 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:20.059711 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e77d5-3dae-474e-86e0-ea589995d158 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:20.060034 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 88/174] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 24 04:00:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:20.060215 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e77d5-3dae-474e-86e0-ea589995d158 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:20.065019 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 87/175] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:00:20.065019 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41e26e-510c-4f5d-9fa7-470f094a3447 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:20.065019 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41e26e-510c-4f5d-9fa7-470f094a3447 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:20.065019 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41e26e-510c-4f5d-9fa7-470f094a3447 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:20.065019 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 88/176] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:00:20.067553 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24e394-e2d6-43f3-9dd6-31e01111e6a2 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:20.068057 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24e394-e2d6-43f3-9dd6-31e01111e6a2 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:20.068524 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24e394-e2d6-43f3-9dd6-31e01111e6a2 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:20.069679 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41e26e-510c-4f5d-9fa7-470f094a3447 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:20.071423 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 89/177] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:20 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:00:20.072983 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b3d1b-5a6f-4716-85a0-d128f9bf09a9 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:20.073739 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b3d1b-5a6f-4716-85a0-d128f9bf09a9 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:20.074214 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b3d1b-5a6f-4716-85a0-d128f9bf09a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:20.094284 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-b16b3d1b-5a6f-4716-85a0-d128f9bf09a9 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:20.096029 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-b16b3d1b-5a6f-4716-85a0-d128f9bf09a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:20.172706 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 90/178] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:00:20.173979 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b3d1b-5a6f-4716-85a0-d128f9bf09a9 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:20.186613 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41e26e-510c-4f5d-9fa7-470f094a3447 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:20.223125 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b1f03-1fb9-4034-8548-d597675000ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:20.224085 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b1f03-1fb9-4034-8548-d597675000ec None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:20.224545 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b1f03-1fb9-4034-8548-d597675000ec None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:20.224910 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b1f03-1fb9-4034-8548-d597675000ec None admin] PATH_INFO: `/v3/projects/b8831e7463bf44df920eb14d1ccf1502` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:20.226287 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b1f03-1fb9-4034-8548-d597675000ec None admin] RBAC: Authorizing `identity:get_project(project_id=b8831e7463bf44df920eb14d1ccf1502)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:20.227585 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:20.229697 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b1f03-1fb9-4034-8548-d597675000ec None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:20.231959 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 89/179] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 24 04:00:20 2022] GET /identity/v3/projects/b8831e7463bf44df920eb14d1ccf1502 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:20.233293 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b491369-8991-4738-8c35-ecf5f41b1acc None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:20.233578 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b491369-8991-4738-8c35-ecf5f41b1acc None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:20.233852 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b491369-8991-4738-8c35-ecf5f41b1acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:20.253806 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-1b491369-8991-4738-8c35-ecf5f41b1acc None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:20.254900 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-1b491369-8991-4738-8c35-ecf5f41b1acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:20.286367 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b3d1b-5a6f-4716-85a0-d128f9bf09a9 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:20.297177 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:20.324095 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f3f88-96bf-4d22-bb3b-1ca4cf485e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:20.324728 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f3f88-96bf-4d22-bb3b-1ca4cf485e95 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:20.325004 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f3f88-96bf-4d22-bb3b-1ca4cf485e95 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:20.325271 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f3f88-96bf-4d22-bb3b-1ca4cf485e95 None admin] PATH_INFO: `/v3/users/c414fa8ffb744c22a2619f1ccb5b8577` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:20.326593 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 90/180] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:00:20.327300 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f3f88-96bf-4d22-bb3b-1ca4cf485e95 None admin] RBAC: Authorizing `identity:get_user(user_id=c414fa8ffb744c22a2619f1ccb5b8577)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:20.327675 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f50110-6012-4b8b-b2f0-d1b8037be983 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:20.327962 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f50110-6012-4b8b-b2f0-d1b8037be983 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:20.328234 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f50110-6012-4b8b-b2f0-d1b8037be983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:20.329654 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f3f88-96bf-4d22-bb3b-1ca4cf485e95 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:20.331870 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 91/181] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 24 04:00:20 2022] GET /identity/v3/users/c414fa8ffb744c22a2619f1ccb5b8577 => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:20.336608 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580259c8-4a74-4708-beb6-e151a8a19e4e None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:20.338491 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580259c8-4a74-4708-beb6-e151a8a19e4e None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:20.338765 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580259c8-4a74-4708-beb6-e151a8a19e4e None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:20.340056 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 92/182] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:00:20.341159 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580259c8-4a74-4708-beb6-e151a8a19e4e None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:20.355207 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-c4f50110-6012-4b8b-b2f0-d1b8037be983 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:20.357002 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-c4f50110-6012-4b8b-b2f0-d1b8037be983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:20.448863 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 91/183] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:00:20.450128 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f50110-6012-4b8b-b2f0-d1b8037be983 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:20.466668 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580259c8-4a74-4708-beb6-e151a8a19e4e None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:20.493616 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:20.524899 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f4e14-f553-4b0a-9952-4b9fd2613eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:20.525737 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f4e14-f553-4b0a-9952-4b9fd2613eb6 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:20.526167 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f4e14-f553-4b0a-9952-4b9fd2613eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:20.526578 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f4e14-f553-4b0a-9952-4b9fd2613eb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:20.527561 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f4e14-f553-4b0a-9952-4b9fd2613eb6 None admin] RBAC: Adding query filter params (role.id=a9f3803644ca4a6fab51b9513141be7b, scope.project.id=b8831e7463bf44df920eb14d1ccf1502, user.id=fd730780576745e9955cd5f707848429) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:20.528002 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f4e14-f553-4b0a-9952-4b9fd2613eb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:20.529582 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f4e14-f553-4b0a-9952-4b9fd2613eb6 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:20.535941 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 93/184] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 24 04:00:20 2022] GET /identity/v3/role_assignments?user.id=fd730780576745e9955cd5f707848429&scope.project.id=b8831e7463bf44df920eb14d1ccf1502&role.id=a9f3803644ca4a6fab51b9513141be7b => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:20.537401 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119414f-d5e1-4ca4-ba51-d50c81f66336 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:20.537844 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119414f-d5e1-4ca4-ba51-d50c81f66336 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:20.538263 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119414f-d5e1-4ca4-ba51-d50c81f66336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:20.556936 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-f119414f-d5e1-4ca4-ba51-d50c81f66336 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:20.558397 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-f119414f-d5e1-4ca4-ba51-d50c81f66336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:20.575419 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f50110-6012-4b8b-b2f0-d1b8037be983 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:20.578465 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:20.617525 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e8e2d-1384-4920-8dd4-8766baca9423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:20.618856 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e8e2d-1384-4920-8dd4-8766baca9423 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:20.618856 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e8e2d-1384-4920-8dd4-8766baca9423 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:20.619258 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e8e2d-1384-4920-8dd4-8766baca9423 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:20.633277 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 94/185] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:00:20.634537 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119414f-d5e1-4ca4-ba51-d50c81f66336 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:20.703236 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e8e2d-1384-4920-8dd4-8766baca9423 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:20.703236 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e8e2d-1384-4920-8dd4-8766baca9423 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:20.783634 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119414f-d5e1-4ca4-ba51-d50c81f66336 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:20.795826 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:20.838543 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c93836-1a32-48df-b480-5f607e84803a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:20.839222 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c93836-1a32-48df-b480-5f607e84803a None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:20.839503 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c93836-1a32-48df-b480-5f607e84803a None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:20.839776 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c93836-1a32-48df-b480-5f607e84803a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:20.863651 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c93836-1a32-48df-b480-5f607e84803a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:00:20.866202 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 92/186] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 24 04:00:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:20.866894 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e8e2d-1384-4920-8dd4-8766baca9423 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:20.871658 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:20.874842 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-30c93836-1a32-48df-b480-5f607e84803a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:00:20.874842 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:00:20.874842 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:00:20.874842 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:00:20.874842 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:00:20.874842 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:00:20.874842 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:00:20.874842 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:00:20.874842 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:00:20.874842 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:00:20.874842 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:00:20.874842 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:00:20.874842 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:00:20.874842 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:00:20.874842 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:00:20.874842 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:00:20.876709 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:00:20.876709 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:00:20.876709 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:00:20.876709 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:00:20.876709 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:00:20.876709 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:00:20.876709 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:00:20.876709 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:00:20.876709 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:00:20.876709 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:00:20.876709 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:00:20.876709 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:00:20.876709 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:00:20.876709 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:00:20.876709 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:00:20.876709 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:00:20.878250 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:00:20.878250 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:00:20.878250 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:00:20.878250 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:00:20.878250 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:00:20.878250 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:00:20.878250 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:00:20.878250 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:00:20.878250 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:00:20.878250 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:00:20.878250 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:00:20.878250 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:00:20.880710 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 95/187] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 24 04:00:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:00:20.881420 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c93836-1a32-48df-b480-5f607e84803a None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:21.007251 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e8e2d-1384-4920-8dd4-8766baca9423 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:21.023033 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c93836-1a32-48df-b480-5f607e84803a None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:21.051818 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed424a-2208-4283-a554-180e74d79c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:21.052369 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed424a-2208-4283-a554-180e74d79c51 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:21.052643 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed424a-2208-4283-a554-180e74d79c51 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:21.052914 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed424a-2208-4283-a554-180e74d79c51 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:21.054056 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ed424a-2208-4283-a554-180e74d79c51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:21.055572 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ed424a-2208-4283-a554-180e74d79c51 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:21.057150 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 93/188] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:00:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:21.057907 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed424a-2208-4283-a554-180e74d79c51 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:21.063032 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73440a02-56bd-4e86-938d-f71d21490340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:21.063738 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73440a02-56bd-4e86-938d-f71d21490340 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:21.064012 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73440a02-56bd-4e86-938d-f71d21490340 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:21.064290 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73440a02-56bd-4e86-938d-f71d21490340 None admin] PATH_INFO: `/v3/projects/b8831e7463bf44df920eb14d1ccf1502` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:21.065478 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73440a02-56bd-4e86-938d-f71d21490340 None admin] RBAC: Authorizing `identity:get_project(project_id=b8831e7463bf44df920eb14d1ccf1502)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:21.067537 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73440a02-56bd-4e86-938d-f71d21490340 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:21.069676 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 96/189] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 24 04:00:20 2022] GET /identity/v3/projects/b8831e7463bf44df920eb14d1ccf1502 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:21.071081 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73440a02-56bd-4e86-938d-f71d21490340 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:21.109251 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:21.137672 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:21.168019 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed424a-2208-4283-a554-180e74d79c51 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:21.175299 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73440a02-56bd-4e86-938d-f71d21490340 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:21.206169 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20962ebc-f61d-4ee0-abe5-bbe8e4294c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:21.206805 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20962ebc-f61d-4ee0-abe5-bbe8e4294c4f None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:21.207061 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20962ebc-f61d-4ee0-abe5-bbe8e4294c4f None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:21.207370 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20962ebc-f61d-4ee0-abe5-bbe8e4294c4f None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:21.208053 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20962ebc-f61d-4ee0-abe5-bbe8e4294c4f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:21.208354 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20962ebc-f61d-4ee0-abe5-bbe8e4294c4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:21.209810 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20962ebc-f61d-4ee0-abe5-bbe8e4294c4f None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:21.214552 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b9e85-1add-4480-ab25-5edaa34d3ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:21.215242 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b9e85-1add-4480-ab25-5edaa34d3ccd None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:21.215530 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b9e85-1add-4480-ab25-5edaa34d3ccd None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:21.215808 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b9e85-1add-4480-ab25-5edaa34d3ccd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:21.219539 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 94/190] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 04:00:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:21.220340 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20962ebc-f61d-4ee0-abe5-bbe8e4294c4f None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:21.228781 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b9e85-1add-4480-ab25-5edaa34d3ccd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:00:21.234253 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-027b9e85-1add-4480-ab25-5edaa34d3ccd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:00:21.234253 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:00:21.234253 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:00:21.234253 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:00:21.234253 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:00:21.234253 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:00:21.234253 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:00:21.234253 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:00:21.234253 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:00:21.234253 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:00:21.234253 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:00:21.234253 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:00:21.234253 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:00:21.234253 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:00:21.234253 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:00:21.234253 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:00:21.235236 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:00:21.235236 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:00:21.235236 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:00:21.235236 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:00:21.235236 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:00:21.235236 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:00:21.235236 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:00:21.235236 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:00:21.235236 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:00:21.235236 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:00:21.235236 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:00:21.235236 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:00:21.235236 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:00:21.235236 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:00:21.235236 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:00:21.235236 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:00:21.236008 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:00:21.236008 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:00:21.236008 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:00:21.236008 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:00:21.236008 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:00:21.236008 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:00:21.236008 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:00:21.236008 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:00:21.236008 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:00:21.236008 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:00:21.236008 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:00:21.236008 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:00:21.236008 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 97/191] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 04:00:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:00:21.236647 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b9e85-1add-4480-ab25-5edaa34d3ccd None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:21.333453 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20962ebc-f61d-4ee0-abe5-bbe8e4294c4f None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:21.337908 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:21.343920 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b9e85-1add-4480-ab25-5edaa34d3ccd None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:21.371835 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214bb4ad-2e1e-4584-a6cd-7afe8ccbcabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:21.371835 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214bb4ad-2e1e-4584-a6cd-7afe8ccbcabb None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:21.372162 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214bb4ad-2e1e-4584-a6cd-7afe8ccbcabb None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:21.372293 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214bb4ad-2e1e-4584-a6cd-7afe8ccbcabb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:21.374217 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:21.380027 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d5425-2199-4b0f-86c5-c0d90fcc114a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:21.380642 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d5425-2199-4b0f-86c5-c0d90fcc114a None admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:21.380919 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d5425-2199-4b0f-86c5-c0d90fcc114a None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:21.381184 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d5425-2199-4b0f-86c5-c0d90fcc114a None admin] PATH_INFO: `/v3/users` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:21.381837 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d5425-2199-4b0f-86c5-c0d90fcc114a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:21.383323 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d5425-2199-4b0f-86c5-c0d90fcc114a None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:21.384232 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214bb4ad-2e1e-4584-a6cd-7afe8ccbcabb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:00:21.389507 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-214bb4ad-2e1e-4584-a6cd-7afe8ccbcabb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:00:21.389507 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:00:21.389507 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:00:21.389507 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:00:21.389507 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:00:21.389507 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:00:21.389507 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:00:21.389507 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:00:21.389507 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:00:21.389507 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:00:21.389507 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:00:21.389507 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:00:21.389507 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:00:21.389507 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:00:21.389507 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:00:21.389507 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:00:21.390407 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:00:21.390407 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:00:21.390407 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:00:21.390407 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:00:21.390407 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:00:21.390407 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:00:21.390407 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:00:21.390407 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:00:21.390407 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:00:21.390407 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:00:21.390407 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:00:21.390407 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:00:21.390407 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:00:21.390407 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:00:21.390407 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:00:21.390407 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:00:21.391176 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:00:21.391176 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:00:21.391176 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:00:21.391176 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:00:21.391176 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:00:21.391176 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:00:21.391176 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:00:21.391176 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:00:21.391176 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:00:21.391176 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:00:21.391176 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:00:21.391176 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:00:21.391176 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 95/192] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Aug 24 04:00:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:00:21.391855 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214bb4ad-2e1e-4584-a6cd-7afe8ccbcabb None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:21.408216 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 98/193] 10.222.0.15 () {60 vars in 1132 bytes} [Wed Aug 24 04:00:21 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:00:21.409092 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d5425-2199-4b0f-86c5-c0d90fcc114a None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:21.511631 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214bb4ad-2e1e-4584-a6cd-7afe8ccbcabb None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:21.526004 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d5425-2199-4b0f-86c5-c0d90fcc114a None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:21.549780 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5f955-253c-44f8-96c9-6ef44639f595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:21.550398 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5f955-253c-44f8-96c9-6ef44639f595 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:21.550677 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5f955-253c-44f8-96c9-6ef44639f595 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:21.550975 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5f955-253c-44f8-96c9-6ef44639f595 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:21.551733 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb5f955-253c-44f8-96c9-6ef44639f595 None admin] RBAC: Adding query filter params (role.id=df6a8bb215d54f71a0b6988a9c01f5e4, scope.project.id=b8831e7463bf44df920eb14d1ccf1502, user.id=c414fa8ffb744c22a2619f1ccb5b8577) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:21.552038 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb5f955-253c-44f8-96c9-6ef44639f595 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:21.553520 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb5f955-253c-44f8-96c9-6ef44639f595 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:21.560481 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 96/194] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 24 04:00:21 2022] GET /identity/v3/role_assignments?user.id=c414fa8ffb744c22a2619f1ccb5b8577&scope.project.id=b8831e7463bf44df920eb14d1ccf1502&role.id=df6a8bb215d54f71a0b6988a9c01f5e4 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:21.563399 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd280d6f-b63f-40d8-a5ce-8803171d8ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:21.564052 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd280d6f-b63f-40d8-a5ce-8803171d8ef1 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:21.564393 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd280d6f-b63f-40d8-a5ce-8803171d8ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:21.564619 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd280d6f-b63f-40d8-a5ce-8803171d8ef1 None admin] PATH_INFO: `/v3/users/b67935aaec7e4f949a1ac5d84793c109` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:21.568497 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5f955-253c-44f8-96c9-6ef44639f595 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:21.583127 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd280d6f-b63f-40d8-a5ce-8803171d8ef1 None admin] RBAC: Authorizing `identity:get_user(user_id=b67935aaec7e4f949a1ac5d84793c109)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:21.585243 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd280d6f-b63f-40d8-a5ce-8803171d8ef1 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:21.587561 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 99/195] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 24 04:00:21 2022] GET /identity/v3/users/b67935aaec7e4f949a1ac5d84793c109 => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:21.588818 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd280d6f-b63f-40d8-a5ce-8803171d8ef1 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:21.607760 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:21.658794 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:21.721908 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5f955-253c-44f8-96c9-6ef44639f595 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:21.726667 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd280d6f-b63f-40d8-a5ce-8803171d8ef1 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:21.773380 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a28194-a43a-4b24-9e35-ae26ede39765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:21.774426 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a28194-a43a-4b24-9e35-ae26ede39765 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:21.774913 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a28194-a43a-4b24-9e35-ae26ede39765 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:21.775470 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a28194-a43a-4b24-9e35-ae26ede39765 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:21.776353 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a28194-a43a-4b24-9e35-ae26ede39765 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:21.776888 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a28194-a43a-4b24-9e35-ae26ede39765 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:21.778451 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a28194-a43a-4b24-9e35-ae26ede39765 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:21.781510 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87a2ef-b428-4bed-9354-fda6d69080e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:21.782121 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87a2ef-b428-4bed-9354-fda6d69080e2 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:21.782396 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87a2ef-b428-4bed-9354-fda6d69080e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:21.782665 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87a2ef-b428-4bed-9354-fda6d69080e2 None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:21.783990 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87a2ef-b428-4bed-9354-fda6d69080e2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:21.784296 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87a2ef-b428-4bed-9354-fda6d69080e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:21.785680 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c87a2ef-b428-4bed-9354-fda6d69080e2 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:21.790179 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 97/196] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 24 04:00:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:21.790992 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a28194-a43a-4b24-9e35-ae26ede39765 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:21.799488 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 100/197] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 24 04:00:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:21.800250 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87a2ef-b428-4bed-9354-fda6d69080e2 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:21.890472 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:21.926906 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87a2ef-b428-4bed-9354-fda6d69080e2 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:21.945499 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a28194-a43a-4b24-9e35-ae26ede39765 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:21.965136 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44690487-6d75-4852-bff8-652fe0db6814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:21.965774 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44690487-6d75-4852-bff8-652fe0db6814 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:21.966051 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44690487-6d75-4852-bff8-652fe0db6814 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:21.966324 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44690487-6d75-4852-bff8-652fe0db6814 None admin] PATH_INFO: `/v3/users/e175ccc6442840e5bacc0d9965ecb103` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:21.968226 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44690487-6d75-4852-bff8-652fe0db6814 None admin] RBAC: Authorizing `identity:get_user(user_id=e175ccc6442840e5bacc0d9965ecb103)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:21.969670 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44690487-6d75-4852-bff8-652fe0db6814 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:21.971429 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 101/198] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 24 04:00:21 2022] GET /identity/v3/users/e175ccc6442840e5bacc0d9965ecb103 => generated 289 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:21.976211 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44690487-6d75-4852-bff8-652fe0db6814 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:21.983400 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:22.001387 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b28dd-5537-42a6-a3e7-1b94d1213192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:22.002348 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b28dd-5537-42a6-a3e7-1b94d1213192 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:22.002793 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b28dd-5537-42a6-a3e7-1b94d1213192 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:22.003260 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b28dd-5537-42a6-a3e7-1b94d1213192 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:22.079530 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3b28dd-5537-42a6-a3e7-1b94d1213192 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:22.080909 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44690487-6d75-4852-bff8-652fe0db6814 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:22.081601 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3b28dd-5537-42a6-a3e7-1b94d1213192 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:22.115848 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b590bd-beaa-4810-9416-cb86b512824c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:22.116484 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b590bd-beaa-4810-9416-cb86b512824c None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:22.116816 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b590bd-beaa-4810-9416-cb86b512824c None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:22.117028 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b590bd-beaa-4810-9416-cb86b512824c None admin] PATH_INFO: `/v3/users/b67935aaec7e4f949a1ac5d84793c109` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:22.118262 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b590bd-beaa-4810-9416-cb86b512824c None admin] RBAC: Authorizing `identity:get_user(user_id=b67935aaec7e4f949a1ac5d84793c109)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:22.119771 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b590bd-beaa-4810-9416-cb86b512824c None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:22.121422 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 102/199] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 24 04:00:21 2022] GET /identity/v3/users/b67935aaec7e4f949a1ac5d84793c109 => generated 283 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:22.122228 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b590bd-beaa-4810-9416-cb86b512824c None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:22.134078 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:22.207325 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 98/200] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 24 04:00:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:22.207325 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b28dd-5537-42a6-a3e7-1b94d1213192 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:22.229291 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:22.240105 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b590bd-beaa-4810-9416-cb86b512824c None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:22.286033 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39efe96a-a2de-4b38-82e2-63c8b65071b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:22.287629 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39efe96a-a2de-4b38-82e2-63c8b65071b0 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:22.288627 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39efe96a-a2de-4b38-82e2-63c8b65071b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:22.289297 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39efe96a-a2de-4b38-82e2-63c8b65071b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:22.318643 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b28dd-5537-42a6-a3e7-1b94d1213192 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:22.371752 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20fa2c2-015e-41d9-b0db-9bea68af0194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:22.374227 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20fa2c2-015e-41d9-b0db-9bea68af0194 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:22.374697 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20fa2c2-015e-41d9-b0db-9bea68af0194 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:22.375162 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20fa2c2-015e-41d9-b0db-9bea68af0194 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:22.384148 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39efe96a-a2de-4b38-82e2-63c8b65071b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:22.385776 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39efe96a-a2de-4b38-82e2-63c8b65071b0 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:22.398644 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:22.473506 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20fa2c2-015e-41d9-b0db-9bea68af0194 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:22.475650 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20fa2c2-015e-41d9-b0db-9bea68af0194 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:22.501461 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:22.503039 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 103/201] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 24 04:00:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:22.504065 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39efe96a-a2de-4b38-82e2-63c8b65071b0 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:22.587782 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 99/202] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 24 04:00:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:22.589044 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20fa2c2-015e-41d9-b0db-9bea68af0194 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:22.610790 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39efe96a-a2de-4b38-82e2-63c8b65071b0 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:22.621306 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:22.650259 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2360f9-f43e-45ea-a1c2-f40c97ee3fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:22.650927 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2360f9-f43e-45ea-a1c2-f40c97ee3fbb None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:22.651221 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2360f9-f43e-45ea-a1c2-f40c97ee3fbb None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:22.651522 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2360f9-f43e-45ea-a1c2-f40c97ee3fbb None admin] PATH_INFO: `/v3/projects/8ecfc9b2a624461bb3d5c27fa0e48b9e` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:22.652671 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2360f9-f43e-45ea-a1c2-f40c97ee3fbb None admin] RBAC: Authorizing `identity:get_project(project_id=8ecfc9b2a624461bb3d5c27fa0e48b9e)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:22.654142 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2360f9-f43e-45ea-a1c2-f40c97ee3fbb None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:22.660756 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 104/203] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 24 04:00:22 2022] GET /identity/v3/projects/8ecfc9b2a624461bb3d5c27fa0e48b9e => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:22.660756 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2360f9-f43e-45ea-a1c2-f40c97ee3fbb None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:22.710051 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20fa2c2-015e-41d9-b0db-9bea68af0194 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:22.732763 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:22.752803 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc522c-03a7-429e-a587-7c6e7e5f54af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:22.753455 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc522c-03a7-429e-a587-7c6e7e5f54af None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:22.753734 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc522c-03a7-429e-a587-7c6e7e5f54af None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:22.754006 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc522c-03a7-429e-a587-7c6e7e5f54af None admin] PATH_INFO: `/v3/projects/b8831e7463bf44df920eb14d1ccf1502` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:22.755905 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc522c-03a7-429e-a587-7c6e7e5f54af None admin] RBAC: Authorizing `identity:get_project(project_id=b8831e7463bf44df920eb14d1ccf1502)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:22.757402 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc522c-03a7-429e-a587-7c6e7e5f54af None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:22.760068 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 100/204] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 24 04:00:22 2022] GET /identity/v3/projects/b8831e7463bf44df920eb14d1ccf1502 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:22.760934 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc522c-03a7-429e-a587-7c6e7e5f54af None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:22.775427 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2360f9-f43e-45ea-a1c2-f40c97ee3fbb None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:22.822239 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9665c8ec-d948-4a4d-8cfd-3928b39704bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:22.823532 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665c8ec-d948-4a4d-8cfd-3928b39704bf None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:22.824037 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665c8ec-d948-4a4d-8cfd-3928b39704bf None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:22.824887 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665c8ec-d948-4a4d-8cfd-3928b39704bf None admin] PATH_INFO: `/v3/projects/8ecfc9b2a624461bb3d5c27fa0e48b9e` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:22.826530 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9665c8ec-d948-4a4d-8cfd-3928b39704bf None admin] RBAC: Authorizing `identity:get_project(project_id=8ecfc9b2a624461bb3d5c27fa0e48b9e)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:22.828420 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9665c8ec-d948-4a4d-8cfd-3928b39704bf None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:22.831371 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 105/205] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 24 04:00:22 2022] GET /identity/v3/projects/8ecfc9b2a624461bb3d5c27fa0e48b9e => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:22.833266 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9665c8ec-d948-4a4d-8cfd-3928b39704bf None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:22.886813 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:22.889561 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc522c-03a7-429e-a587-7c6e7e5f54af None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:22.932361 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f598198-dc39-40de-b193-01a06277dc5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:22.933385 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f598198-dc39-40de-b193-01a06277dc5c None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:22.933929 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f598198-dc39-40de-b193-01a06277dc5c None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:22.934395 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f598198-dc39-40de-b193-01a06277dc5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:22.935361 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f598198-dc39-40de-b193-01a06277dc5c None admin] RBAC: Adding query filter params (role.id=df6a8bb215d54f71a0b6988a9c01f5e4, scope.project.id=8ecfc9b2a624461bb3d5c27fa0e48b9e, user.id=b67935aaec7e4f949a1ac5d84793c109) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:22.935868 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f598198-dc39-40de-b193-01a06277dc5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:22.937591 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f598198-dc39-40de-b193-01a06277dc5c None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:22.943898 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 101/206] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 24 04:00:22 2022] GET /identity/v3/role_assignments?user.id=b67935aaec7e4f949a1ac5d84793c109&scope.project.id=8ecfc9b2a624461bb3d5c27fa0e48b9e&role.id=df6a8bb215d54f71a0b6988a9c01f5e4 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:22.945364 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f598198-dc39-40de-b193-01a06277dc5c None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:22.960589 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9665c8ec-d948-4a4d-8cfd-3928b39704bf None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:23.002786 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca72ce-8696-484a-9272-4b0175b58c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:23.003322 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca72ce-8696-484a-9272-4b0175b58c4a None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:23.003603 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca72ce-8696-484a-9272-4b0175b58c4a None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:23.003875 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca72ce-8696-484a-9272-4b0175b58c4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:23.004598 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca72ce-8696-484a-9272-4b0175b58c4a None admin] RBAC: Adding query filter params (role.id=63bae148a6d14d6ca8cb30fca2851df5, scope.project.id=b8831e7463bf44df920eb14d1ccf1502, user.id=e175ccc6442840e5bacc0d9965ecb103) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:23.004909 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca72ce-8696-484a-9272-4b0175b58c4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:23.006616 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:23.007554 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca72ce-8696-484a-9272-4b0175b58c4a None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:23.015446 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 106/207] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 24 04:00:22 2022] GET /identity/v3/role_assignments?user.id=e175ccc6442840e5bacc0d9965ecb103&scope.project.id=b8831e7463bf44df920eb14d1ccf1502&role.id=63bae148a6d14d6ca8cb30fca2851df5 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:23.063407 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f598198-dc39-40de-b193-01a06277dc5c None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:23.104504 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af8b3f-9d20-49a3-9162-73c7c1c862bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:23.105231 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af8b3f-9d20-49a3-9162-73c7c1c862bf None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:23.105525 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af8b3f-9d20-49a3-9162-73c7c1c862bf None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:23.105799 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af8b3f-9d20-49a3-9162-73c7c1c862bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:23.106584 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af8b3f-9d20-49a3-9162-73c7c1c862bf None admin] RBAC: Adding query filter params (role.id=a9f3803644ca4a6fab51b9513141be7b, scope.project.id=8ecfc9b2a624461bb3d5c27fa0e48b9e, user.id=b67935aaec7e4f949a1ac5d84793c109) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:23.106895 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af8b3f-9d20-49a3-9162-73c7c1c862bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:23.108431 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af8b3f-9d20-49a3-9162-73c7c1c862bf None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:23.115465 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 102/208] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 24 04:00:22 2022] GET /identity/v3/role_assignments?user.id=b67935aaec7e4f949a1ac5d84793c109&scope.project.id=8ecfc9b2a624461bb3d5c27fa0e48b9e&role.id=a9f3803644ca4a6fab51b9513141be7b => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:23.948873 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48627f7d-d68b-4967-9103-5d0cda000cd8 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:23.949402 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48627f7d-d68b-4967-9103-5d0cda000cd8 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:23.949402 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48627f7d-d68b-4967-9103-5d0cda000cd8 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:23.950996 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 107/209] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:00:23.957139 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c250e6-3d1c-44f4-b3e3-29bbfef70a51 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:23.957665 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c250e6-3d1c-44f4-b3e3-29bbfef70a51 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:23.957665 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c250e6-3d1c-44f4-b3e3-29bbfef70a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:23.978486 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-b3c250e6-3d1c-44f4-b3e3-29bbfef70a51 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:23.979759 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-b3c250e6-3d1c-44f4-b3e3-29bbfef70a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:24.055043 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 103/210] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:00:24.085149 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634dfc58-146e-4caa-acb5-c6fea9036cef None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:24.085581 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634dfc58-146e-4caa-acb5-c6fea9036cef None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:24.085868 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634dfc58-146e-4caa-acb5-c6fea9036cef None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:24.087666 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 108/211] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:00:24.093824 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b5eb3-b1b8-4aa7-95da-c096eb80997a None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:24.094104 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b5eb3-b1b8-4aa7-95da-c096eb80997a None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:24.094376 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b5eb3-b1b8-4aa7-95da-c096eb80997a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:24.117358 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-e87b5eb3-b1b8-4aa7-95da-c096eb80997a None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:24.118601 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-e87b5eb3-b1b8-4aa7-95da-c096eb80997a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:24.165249 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:24.197492 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 104/212] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:00:24.402919 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634dfc58-146e-4caa-acb5-c6fea9036cef None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:24.510641 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634dfc58-146e-4caa-acb5-c6fea9036cef None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:24.520437 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:24.546620 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c6b8c-248e-4d1b-b64f-e5e061cc9440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:24.547288 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c6b8c-248e-4d1b-b64f-e5e061cc9440 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:24.547571 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c6b8c-248e-4d1b-b64f-e5e061cc9440 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:24.547844 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c6b8c-248e-4d1b-b64f-e5e061cc9440 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:24.558809 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b5eb3-b1b8-4aa7-95da-c096eb80997a None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:24.566082 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c6b8c-248e-4d1b-b64f-e5e061cc9440 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:00:24.566082 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-cb4c6b8c-248e-4d1b-b64f-e5e061cc9440 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:00:24.566082 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:00:24.566082 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:00:24.566082 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:00:24.566082 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:00:24.566082 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:00:24.566082 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:00:24.566082 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:00:24.566082 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:00:24.566082 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:00:24.566082 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:00:24.566082 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:00:24.566082 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:00:24.567062 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:00:24.567062 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:00:24.567062 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:00:24.567062 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:00:24.567062 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:00:24.567062 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:00:24.567062 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:00:24.567062 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:00:24.567062 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:00:24.567062 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:00:24.567062 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:00:24.567062 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:00:24.567062 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:00:24.567062 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:00:24.567062 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:00:24.567062 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:00:24.567062 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:00:24.567933 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:00:24.567933 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:00:24.567933 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:00:24.567933 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:00:24.567933 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:00:24.567933 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:00:24.567933 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:00:24.567933 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:00:24.567933 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:00:24.567933 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:00:24.567933 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:00:24.567933 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:00:24.567933 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:00:24.567933 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:00:24.567933 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 109/213] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 04:00:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:00:24.574424 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c6b8c-248e-4d1b-b64f-e5e061cc9440 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:24.695650 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b5eb3-b1b8-4aa7-95da-c096eb80997a None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:24.703644 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c6b8c-248e-4d1b-b64f-e5e061cc9440 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:24.739692 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4970794-050d-4d2f-b51e-ba15b9fbc416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:24.740670 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4970794-050d-4d2f-b51e-ba15b9fbc416 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:24.740898 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6493cfe4-0e5e-40da-9469-620ca1e85948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:24.741385 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4970794-050d-4d2f-b51e-ba15b9fbc416 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:24.741557 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493cfe4-0e5e-40da-9469-620ca1e85948 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:24.741816 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493cfe4-0e5e-40da-9469-620ca1e85948 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:24.742092 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493cfe4-0e5e-40da-9469-620ca1e85948 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:24.742420 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4970794-050d-4d2f-b51e-ba15b9fbc416 None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:24.743336 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4970794-050d-4d2f-b51e-ba15b9fbc416 None admin] RBAC: Adding query filter params (name=member) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:24.743438 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6493cfe4-0e5e-40da-9469-620ca1e85948 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:24.743918 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4970794-050d-4d2f-b51e-ba15b9fbc416 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:24.744813 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6493cfe4-0e5e-40da-9469-620ca1e85948 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:24.745693 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4970794-050d-4d2f-b51e-ba15b9fbc416 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:24.746402 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 105/214] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:00:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:00:24.752518 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6493cfe4-0e5e-40da-9469-620ca1e85948 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:24.760117 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 110/215] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 24 04:00:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:00:24.766955 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4970794-050d-4d2f-b51e-ba15b9fbc416 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:24.804112 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:24.810614 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:24.870020 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6493cfe4-0e5e-40da-9469-620ca1e85948 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:24.893744 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4970794-050d-4d2f-b51e-ba15b9fbc416 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:24.912494 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c712ab0-38bb-4636-85e6-36517035831f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:24.913526 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c712ab0-38bb-4636-85e6-36517035831f None admin] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:24.914027 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c712ab0-38bb-4636-85e6-36517035831f None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:24.914491 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c712ab0-38bb-4636-85e6-36517035831f None admin] PATH_INFO: `/v3/users` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:24.915451 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c712ab0-38bb-4636-85e6-36517035831f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:24.917229 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c712ab0-38bb-4636-85e6-36517035831f None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:24.933210 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328da374-c240-43f9-8664-9c40af13ec59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:24.934335 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328da374-c240-43f9-8664-9c40af13ec59 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:24.934748 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328da374-c240-43f9-8664-9c40af13ec59 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:24.935162 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328da374-c240-43f9-8664-9c40af13ec59 None admin] PATH_INFO: `/v3/users/fe1e79cdae7145c8aa2f8de9dc78bfe8` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:24.952327 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 106/216] 10.222.0.15 () {60 vars in 1132 bytes} [Wed Aug 24 04:00:24 2022] POST /identity/v3/users => generated 297 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:00:24.961009 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328da374-c240-43f9-8664-9c40af13ec59 None admin] RBAC: Authorizing `identity:get_user(user_id=fe1e79cdae7145c8aa2f8de9dc78bfe8)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:24.963518 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328da374-c240-43f9-8664-9c40af13ec59 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:24.965537 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 111/217] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 24 04:00:24 2022] GET /identity/v3/users/fe1e79cdae7145c8aa2f8de9dc78bfe8 => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:00:24.974860 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c712ab0-38bb-4636-85e6-36517035831f None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:25.097256 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:25.101751 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c712ab0-38bb-4636-85e6-36517035831f None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:25.149038 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36372d2-056c-493b-9922-8ea6bef4f763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:25.150120 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36372d2-056c-493b-9922-8ea6bef4f763 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:25.150599 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36372d2-056c-493b-9922-8ea6bef4f763 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:25.151062 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36372d2-056c-493b-9922-8ea6bef4f763 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:25.229870 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36372d2-056c-493b-9922-8ea6bef4f763 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:25.231405 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36372d2-056c-493b-9922-8ea6bef4f763 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:25.336896 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4862b0e-6c17-475f-a180-e0091f672988 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:25.337230 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4862b0e-6c17-475f-a180-e0091f672988 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:25.337449 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4862b0e-6c17-475f-a180-e0091f672988 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:25.338802 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 112/218] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:00:25.341982 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:25.344558 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d484e67-affd-436e-a159-7f6106d9492e None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:25.344843 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d484e67-affd-436e-a159-7f6106d9492e None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:25.345393 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d484e67-affd-436e-a159-7f6106d9492e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:25.348193 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 107/219] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 24 04:00:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:25.353049 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36372d2-056c-493b-9922-8ea6bef4f763 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:25.368143 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-5d484e67-affd-436e-a159-7f6106d9492e None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:25.369820 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-5d484e67-affd-436e-a159-7f6106d9492e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:25.453346 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 113/220] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:00:25.468184 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36372d2-056c-493b-9922-8ea6bef4f763 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:25.488695 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378042a-e2ae-499a-ba62-d57eaeca180e None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:25.489025 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378042a-e2ae-499a-ba62-d57eaeca180e None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:25.489239 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378042a-e2ae-499a-ba62-d57eaeca180e None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:25.490756 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 114/221] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:00:25.496298 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e7724-0ac3-4b1a-8981-548bc425f9fc None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:25.496864 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e7724-0ac3-4b1a-8981-548bc425f9fc None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:25.497371 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e7724-0ac3-4b1a-8981-548bc425f9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:25.515127 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1a37d-d704-4327-a2d1-8add3c492dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:25.515802 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1a37d-d704-4327-a2d1-8add3c492dba None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:25.516078 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1a37d-d704-4327-a2d1-8add3c492dba None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:25.516350 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1a37d-d704-4327-a2d1-8add3c492dba None admin] PATH_INFO: `/v3/projects/8ecfc9b2a624461bb3d5c27fa0e48b9e` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:25.517484 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d1a37d-d704-4327-a2d1-8add3c492dba None admin] RBAC: Authorizing `identity:get_project(project_id=8ecfc9b2a624461bb3d5c27fa0e48b9e)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:25.518388 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-337e7724-0ac3-4b1a-8981-548bc425f9fc None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:25.519007 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d1a37d-d704-4327-a2d1-8add3c492dba None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:25.520011 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-337e7724-0ac3-4b1a-8981-548bc425f9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:25.520681 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 108/222] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 24 04:00:25 2022] GET /identity/v3/projects/8ecfc9b2a624461bb3d5c27fa0e48b9e => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:25.527026 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1a37d-d704-4327-a2d1-8add3c492dba None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:25.539404 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:25.607632 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 115/223] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:00:25.608027 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:25.634149 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1a37d-d704-4327-a2d1-8add3c492dba None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:25.669360 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc776b26-d47a-447a-a287-36941e726556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:25.670023 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc776b26-d47a-447a-a287-36941e726556 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:25.670301 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc776b26-d47a-447a-a287-36941e726556 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:25.670566 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc776b26-d47a-447a-a287-36941e726556 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:25.671315 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc776b26-d47a-447a-a287-36941e726556 None admin] RBAC: Adding query filter params (role.id=5d03284e31284f60bcc99e4843279067, scope.project.id=8ecfc9b2a624461bb3d5c27fa0e48b9e, user.id=fe1e79cdae7145c8aa2f8de9dc78bfe8) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:25.671623 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc776b26-d47a-447a-a287-36941e726556 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:25.673064 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc776b26-d47a-447a-a287-36941e726556 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:25.679246 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 109/224] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 24 04:00:25 2022] GET /identity/v3/role_assignments?user.id=fe1e79cdae7145c8aa2f8de9dc78bfe8&scope.project.id=8ecfc9b2a624461bb3d5c27fa0e48b9e&role.id=5d03284e31284f60bcc99e4843279067 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:25.899625 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e7724-0ac3-4b1a-8981-548bc425f9fc None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:25.940408 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc776b26-d47a-447a-a287-36941e726556 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:26.071045 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e7724-0ac3-4b1a-8981-548bc425f9fc None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:26.124813 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc776b26-d47a-447a-a287-36941e726556 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:26.142095 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092893a-593e-4151-963d-d0f2f9978e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:26.142740 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092893a-593e-4151-963d-d0f2f9978e9a None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:26.143022 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092893a-593e-4151-963d-d0f2f9978e9a None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:26.143315 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092893a-593e-4151-963d-d0f2f9978e9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:26.163899 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092893a-593e-4151-963d-d0f2f9978e9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:00:26.168780 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-2092893a-593e-4151-963d-d0f2f9978e9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:00:26.168780 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:00:26.168780 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:00:26.168780 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:00:26.168780 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:00:26.168780 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:00:26.168780 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:00:26.168780 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:00:26.168780 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:00:26.168780 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:00:26.168780 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:00:26.168780 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:00:26.168780 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:00:26.168780 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:00:26.168780 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:00:26.168780 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:00:26.169647 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:00:26.169647 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:00:26.169647 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:00:26.169647 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:00:26.169647 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:00:26.169647 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:00:26.169647 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:00:26.169647 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:00:26.169647 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:00:26.169647 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:00:26.169647 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:00:26.169647 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:00:26.169647 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:00:26.169647 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:00:26.169647 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:00:26.169647 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:00:26.170831 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:00:26.170831 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:00:26.170831 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:00:26.170831 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:00:26.170831 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:00:26.170831 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:00:26.170831 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:00:26.170831 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:00:26.170831 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:00:26.170831 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:00:26.170831 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:00:26.170831 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:00:26.170831 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 116/225] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 24 04:00:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:00:26.177675 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092893a-593e-4151-963d-d0f2f9978e9a None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:26.184307 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:26.196356 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7b5ab-cdfa-4960-9a4c-692fcce71983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:26.197003 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7b5ab-cdfa-4960-9a4c-692fcce71983 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:26.197273 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7b5ab-cdfa-4960-9a4c-692fcce71983 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:26.197540 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f7b5ab-cdfa-4960-9a4c-692fcce71983 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:26.201489 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:26.220243 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f7b5ab-cdfa-4960-9a4c-692fcce71983 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:00:26.225791 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-b9f7b5ab-cdfa-4960-9a4c-692fcce71983 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:00:26.225791 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:00:26.225791 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:00:26.225791 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:00:26.225791 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:00:26.225791 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:00:26.225791 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:00:26.225791 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:00:26.225791 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:00:26.225791 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:00:26.225791 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:00:26.225791 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:00:26.225791 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:00:26.225791 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:00:26.225791 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:00:26.225791 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:00:26.228069 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:00:26.228069 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:00:26.228069 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:00:26.228069 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:00:26.228069 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:00:26.228069 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:00:26.228069 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:00:26.228069 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:00:26.228069 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:00:26.228069 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:00:26.228069 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:00:26.228069 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:00:26.228069 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:00:26.228069 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:00:26.228069 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:00:26.228069 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:00:26.230002 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:00:26.230002 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:00:26.230002 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:00:26.230002 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:00:26.230002 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:00:26.230002 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:00:26.230002 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:00:26.230002 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:00:26.230002 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:00:26.230002 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:00:26.230002 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:00:26.230002 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:00:26.230002 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 110/226] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Aug 24 04:00:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:00:26.234928 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7b5ab-cdfa-4960-9a4c-692fcce71983 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:26.356493 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f7b5ab-cdfa-4960-9a4c-692fcce71983 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:26.393774 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd7228-cf42-4f32-a57f-d9d086bb5762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:26.394646 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd7228-cf42-4f32-a57f-d9d086bb5762 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:26.395065 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd7228-cf42-4f32-a57f-d9d086bb5762 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:26.395528 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd7228-cf42-4f32-a57f-d9d086bb5762 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:26.396467 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd7228-cf42-4f32-a57f-d9d086bb5762 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:26.396911 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd7228-cf42-4f32-a57f-d9d086bb5762 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:26.398442 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd7228-cf42-4f32-a57f-d9d086bb5762 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:26.407136 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092893a-593e-4151-963d-d0f2f9978e9a None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:26.408299 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 111/227] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 24 04:00:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:26.414176 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd7228-cf42-4f32-a57f-d9d086bb5762 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:26.477646 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:26.504018 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14d2c4-c73a-404a-a6f8-d076b11b4459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:26.504653 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14d2c4-c73a-404a-a6f8-d076b11b4459 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:26.504937 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14d2c4-c73a-404a-a6f8-d076b11b4459 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:26.505539 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14d2c4-c73a-404a-a6f8-d076b11b4459 None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:26.506782 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14d2c4-c73a-404a-a6f8-d076b11b4459 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:26.507090 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14d2c4-c73a-404a-a6f8-d076b11b4459 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:26.508629 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14d2c4-c73a-404a-a6f8-d076b11b4459 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:26.526980 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 117/228] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 04:00:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:26.532112 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14d2c4-c73a-404a-a6f8-d076b11b4459 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:26.532666 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd7228-cf42-4f32-a57f-d9d086bb5762 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:26.615774 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa10896-563c-428f-bb22-f88169b260e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:26.616425 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa10896-563c-428f-bb22-f88169b260e0 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:26.616704 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa10896-563c-428f-bb22-f88169b260e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:26.616977 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa10896-563c-428f-bb22-f88169b260e0 None admin] PATH_INFO: `/v3/users/b67935aaec7e4f949a1ac5d84793c109` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:26.619669 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa10896-563c-428f-bb22-f88169b260e0 None admin] RBAC: Authorizing `identity:get_user(user_id=b67935aaec7e4f949a1ac5d84793c109)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:26.621469 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa10896-563c-428f-bb22-f88169b260e0 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:26.628247 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 112/229] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 24 04:00:26 2022] GET /identity/v3/users/b67935aaec7e4f949a1ac5d84793c109 => generated 283 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:00:26.630102 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa10896-563c-428f-bb22-f88169b260e0 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:26.660686 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:26.701446 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14d2c4-c73a-404a-a6f8-d076b11b4459 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:26.737201 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e07971d-9d0e-4619-9edb-fdd78d8b7ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:26.737849 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07971d-9d0e-4619-9edb-fdd78d8b7ad0 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:26.738134 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07971d-9d0e-4619-9edb-fdd78d8b7ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:26.738414 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07971d-9d0e-4619-9edb-fdd78d8b7ad0 None admin] PATH_INFO: `/v3/users/b67935aaec7e4f949a1ac5d84793c109` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:26.739606 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e07971d-9d0e-4619-9edb-fdd78d8b7ad0 None admin] RBAC: Authorizing `identity:get_user(user_id=b67935aaec7e4f949a1ac5d84793c109)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:26.741213 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e07971d-9d0e-4619-9edb-fdd78d8b7ad0 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:26.742890 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 118/230] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 24 04:00:26 2022] GET /identity/v3/users/b67935aaec7e4f949a1ac5d84793c109 => generated 283 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:00:26.748490 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e07971d-9d0e-4619-9edb-fdd78d8b7ad0 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:26.815142 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa10896-563c-428f-bb22-f88169b260e0 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:26.856595 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:26.858741 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e07971d-9d0e-4619-9edb-fdd78d8b7ad0 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:26.892624 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470ca9f-2313-4340-a101-e3b27db2eb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:26.892837 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470ca9f-2313-4340-a101-e3b27db2eb98 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:26.893024 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470ca9f-2313-4340-a101-e3b27db2eb98 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:26.896457 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470ca9f-2313-4340-a101-e3b27db2eb98 None admin] PATH_INFO: `/v3/projects/8ecfc9b2a624461bb3d5c27fa0e48b9e` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:26.896457 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470ca9f-2313-4340-a101-e3b27db2eb98 None admin] RBAC: Authorizing `identity:get_project(project_id=8ecfc9b2a624461bb3d5c27fa0e48b9e)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:26.896457 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470ca9f-2313-4340-a101-e3b27db2eb98 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:26.898062 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 113/231] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 24 04:00:26 2022] GET /identity/v3/projects/8ecfc9b2a624461bb3d5c27fa0e48b9e => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:26.904212 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470ca9f-2313-4340-a101-e3b27db2eb98 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:26.911011 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a382a-3abb-4251-a11d-2e98efb46ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:26.911878 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a382a-3abb-4251-a11d-2e98efb46ff6 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:26.912402 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a382a-3abb-4251-a11d-2e98efb46ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:26.913527 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a382a-3abb-4251-a11d-2e98efb46ff6 None admin] PATH_INFO: `/v3/projects/8ecfc9b2a624461bb3d5c27fa0e48b9e` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:26.915054 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a382a-3abb-4251-a11d-2e98efb46ff6 None admin] RBAC: Authorizing `identity:get_project(project_id=8ecfc9b2a624461bb3d5c27fa0e48b9e)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:26.919666 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a382a-3abb-4251-a11d-2e98efb46ff6 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:26.923144 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 119/232] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 24 04:00:26 2022] GET /identity/v3/projects/8ecfc9b2a624461bb3d5c27fa0e48b9e => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:26.935588 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a382a-3abb-4251-a11d-2e98efb46ff6 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:26.946971 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:27.048850 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470ca9f-2313-4340-a101-e3b27db2eb98 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:27.079955 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a382a-3abb-4251-a11d-2e98efb46ff6 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:27.117384 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f851317-a2ba-4617-a20b-0782a47e58df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:27.118331 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f851317-a2ba-4617-a20b-0782a47e58df None admin] REQUEST_METHOD: `PUT` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:27.118790 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f851317-a2ba-4617-a20b-0782a47e58df None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:27.119235 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f851317-a2ba-4617-a20b-0782a47e58df None admin] PATH_INFO: `/v3/projects/8ecfc9b2a624461bb3d5c27fa0e48b9e/users/b67935aaec7e4f949a1ac5d84793c109/roles/df6a8bb215d54f71a0b6988a9c01f5e4` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:27.119347 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f3095-1a45-467a-b4b4-839cb454cb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:27.119957 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f3095-1a45-467a-b4b4-839cb454cb63 None admin] REQUEST_METHOD: `PUT` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:27.120241 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f3095-1a45-467a-b4b4-839cb454cb63 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:27.120517 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f3095-1a45-467a-b4b4-839cb454cb63 None admin] PATH_INFO: `/v3/projects/8ecfc9b2a624461bb3d5c27fa0e48b9e/users/b67935aaec7e4f949a1ac5d84793c109/roles/a9f3803644ca4a6fab51b9513141be7b` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:27.122219 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f851317-a2ba-4617-a20b-0782a47e58df None admin] RBAC: Authorizing `identity:create_grant(project_id=8ecfc9b2a624461bb3d5c27fa0e48b9e, user_id=b67935aaec7e4f949a1ac5d84793c109, role_id=df6a8bb215d54f71a0b6988a9c01f5e4)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:27.122857 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f3095-1a45-467a-b4b4-839cb454cb63 None admin] RBAC: Authorizing `identity:create_grant(project_id=8ecfc9b2a624461bb3d5c27fa0e48b9e, user_id=b67935aaec7e4f949a1ac5d84793c109, role_id=a9f3803644ca4a6fab51b9513141be7b)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:27.124024 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f851317-a2ba-4617-a20b-0782a47e58df None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:27.129559 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f3095-1a45-467a-b4b4-839cb454cb63 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:27.152211 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 120/233] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Aug 24 04:00:26 2022] PUT /identity/v3/projects/8ecfc9b2a624461bb3d5c27fa0e48b9e/users/b67935aaec7e4f949a1ac5d84793c109/roles/df6a8bb215d54f71a0b6988a9c01f5e4 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:00:27.154654 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 114/234] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Aug 24 04:00:26 2022] PUT /identity/v3/projects/8ecfc9b2a624461bb3d5c27fa0e48b9e/users/b67935aaec7e4f949a1ac5d84793c109/roles/a9f3803644ca4a6fab51b9513141be7b => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:00:27.845663 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eae921-d4d2-4326-b50d-a34f628d7b25 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:27.846092 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eae921-d4d2-4326-b50d-a34f628d7b25 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:27.846215 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eae921-d4d2-4326-b50d-a34f628d7b25 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:27.847614 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 121/235] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:00:27.853612 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd739a-8b71-4471-9b42-63962cca3c49 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:27.853899 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd739a-8b71-4471-9b42-63962cca3c49 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:27.854178 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd739a-8b71-4471-9b42-63962cca3c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:27.884341 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-18bd739a-8b71-4471-9b42-63962cca3c49 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:27.885560 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-18bd739a-8b71-4471-9b42-63962cca3c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:27.957316 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:27.983853 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 115/236] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:00:28.143926 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925ec87-8ea2-4a63-8b06-bea2803f7b94 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:28.144927 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925ec87-8ea2-4a63-8b06-bea2803f7b94 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:28.145415 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925ec87-8ea2-4a63-8b06-bea2803f7b94 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:28.147158 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 122/237] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:00:28.153519 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ac49f-7b2c-4008-981e-b8c77c784c8c None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:28.154046 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ac49f-7b2c-4008-981e-b8c77c784c8c None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:28.154046 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ac49f-7b2c-4008-981e-b8c77c784c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:28.179539 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-5e2ac49f-7b2c-4008-981e-b8c77c784c8c None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:28.180819 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-5e2ac49f-7b2c-4008-981e-b8c77c784c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:28.273758 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 116/238] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:00:28.318311 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c20818-24a9-43b5-8d6d-eb4ce0c4bb8e None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:28.318640 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c20818-24a9-43b5-8d6d-eb4ce0c4bb8e None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:28.318873 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c20818-24a9-43b5-8d6d-eb4ce0c4bb8e None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:28.320792 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 123/239] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:00:28.326511 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b519e-a10f-490b-bf93-029e609323dc None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:28.326791 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b519e-a10f-490b-bf93-029e609323dc None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:28.327059 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b519e-a10f-490b-bf93-029e609323dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:28.346547 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-475b519e-a10f-490b-bf93-029e609323dc None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:28.348063 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-475b519e-a10f-490b-bf93-029e609323dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:28.429947 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 117/240] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:00:28.565101 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c20818-24a9-43b5-8d6d-eb4ce0c4bb8e None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:28.646724 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:28.696936 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c20818-24a9-43b5-8d6d-eb4ce0c4bb8e None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:28.741868 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c72103e-ea6c-4ab3-af59-85768495ae2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:28.742496 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72103e-ea6c-4ab3-af59-85768495ae2d None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:28.742804 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72103e-ea6c-4ab3-af59-85768495ae2d None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:28.743074 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72103e-ea6c-4ab3-af59-85768495ae2d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:28.762196 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c72103e-ea6c-4ab3-af59-85768495ae2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:00:28.766979 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-5c72103e-ea6c-4ab3-af59-85768495ae2d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:00:28.766979 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:00:28.766979 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:00:28.766979 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:00:28.766979 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:00:28.766979 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:00:28.766979 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:00:28.766979 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:00:28.766979 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:00:28.766979 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:00:28.766979 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:00:28.766979 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:00:28.766979 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:00:28.766979 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:00:28.766979 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:00:28.766979 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:00:28.767885 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:00:28.767885 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:00:28.767885 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:00:28.767885 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:00:28.767885 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:00:28.767885 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:00:28.767885 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:00:28.767885 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:00:28.767885 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:00:28.767885 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:00:28.767885 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:00:28.767885 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:00:28.767885 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:00:28.767885 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:00:28.767885 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:00:28.767885 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:00:28.768705 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:00:28.768705 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:00:28.768705 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:00:28.768705 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:00:28.768705 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:00:28.768705 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:00:28.768705 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:00:28.768705 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:00:28.768705 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:00:28.768705 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:00:28.768705 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:00:28.768705 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:00:28.768705 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 124/241] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 04:00:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:00:28.775895 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b519e-a10f-490b-bf93-029e609323dc None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:28.813802 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c72103e-ea6c-4ab3-af59-85768495ae2d None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:28.853942 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:28.940796 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b519e-a10f-490b-bf93-029e609323dc None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:28.963516 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c72103e-ea6c-4ab3-af59-85768495ae2d None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:28.988545 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae385d5e-3ddc-4374-a503-9b54e29de2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:28.989313 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae385d5e-3ddc-4374-a503-9b54e29de2dd None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:28.990107 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae385d5e-3ddc-4374-a503-9b54e29de2dd None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:28.990493 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae385d5e-3ddc-4374-a503-9b54e29de2dd None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:28.991626 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae385d5e-3ddc-4374-a503-9b54e29de2dd None admin] RBAC: Adding query filter params (name=reader) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:28.992026 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae385d5e-3ddc-4374-a503-9b54e29de2dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:28.993014 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:28.995624 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae385d5e-3ddc-4374-a503-9b54e29de2dd None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:29.002700 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6a163-3975-4680-a872-b08655ed2379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:29.003544 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6a163-3975-4680-a872-b08655ed2379 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:29.003967 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6a163-3975-4680-a872-b08655ed2379 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:29.004405 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6a163-3975-4680-a872-b08655ed2379 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:29.005668 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc6a163-3975-4680-a872-b08655ed2379 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:29.011037 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 118/242] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 24 04:00:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:29.011037 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae385d5e-3ddc-4374-a503-9b54e29de2dd None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:29.012539 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc6a163-3975-4680-a872-b08655ed2379 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:29.014632 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 125/243] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:00:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:00:29.015658 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6a163-3975-4680-a872-b08655ed2379 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:29.126712 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6a163-3975-4680-a872-b08655ed2379 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:29.136478 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae385d5e-3ddc-4374-a503-9b54e29de2dd None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:29.138610 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:29.174367 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba86c6-7354-4653-9f9f-8b3912746b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:29.175179 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba86c6-7354-4653-9f9f-8b3912746b3f None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:29.175583 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba86c6-7354-4653-9f9f-8b3912746b3f None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:29.175966 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba86c6-7354-4653-9f9f-8b3912746b3f None admin] PATH_INFO: `/v3/users/38fbe685e070498897954547d94c867e` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:29.179067 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12bb464-37c2-4c59-a80a-82b502756bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:29.180352 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bb464-37c2-4c59-a80a-82b502756bc5 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:29.180854 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bb464-37c2-4c59-a80a-82b502756bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:29.181321 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bb464-37c2-4c59-a80a-82b502756bc5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:29.192280 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba86c6-7354-4653-9f9f-8b3912746b3f None admin] RBAC: Authorizing `identity:get_user(user_id=38fbe685e070498897954547d94c867e)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:29.193901 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12bb464-37c2-4c59-a80a-82b502756bc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:00:29.194131 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba86c6-7354-4653-9f9f-8b3912746b3f None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:29.201302 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 126/244] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 24 04:00:29 2022] GET /identity/v3/users/38fbe685e070498897954547d94c867e => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:29.201302 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba86c6-7354-4653-9f9f-8b3912746b3f None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:29.205123 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-d12bb464-37c2-4c59-a80a-82b502756bc5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:00:29.205123 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:00:29.205123 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:00:29.205123 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:00:29.205123 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:00:29.205123 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:00:29.205123 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:00:29.205123 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:00:29.205123 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:00:29.205123 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:00:29.205123 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:00:29.205123 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:00:29.205123 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:00:29.205123 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:00:29.205123 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:00:29.205123 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:00:29.206020 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:00:29.206020 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:00:29.206020 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:00:29.206020 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:00:29.206020 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:00:29.206020 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:00:29.206020 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:00:29.206020 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:00:29.206020 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:00:29.206020 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:00:29.206020 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:00:29.206020 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:00:29.206020 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:00:29.206020 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:00:29.206020 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:00:29.206020 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:00:29.206806 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:00:29.206806 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:00:29.206806 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:00:29.206806 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:00:29.206806 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:00:29.206806 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:00:29.206806 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:00:29.206806 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:00:29.206806 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:00:29.206806 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:00:29.206806 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:00:29.206806 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:00:29.207444 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 119/245] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 04:00:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:00:29.208005 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12bb464-37c2-4c59-a80a-82b502756bc5 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:29.279185 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:29.325557 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12bb464-37c2-4c59-a80a-82b502756bc5 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:29.344384 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba86c6-7354-4653-9f9f-8b3912746b3f None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:29.372516 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe8ea9-4407-4b01-803f-89561cca0078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:29.373173 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe8ea9-4407-4b01-803f-89561cca0078 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:29.373453 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe8ea9-4407-4b01-803f-89561cca0078 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:29.373725 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe8ea9-4407-4b01-803f-89561cca0078 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:29.390318 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d2823-7c68-4536-88e5-667f2ec548e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:29.391351 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d2823-7c68-4536-88e5-667f2ec548e1 None admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:29.391883 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d2823-7c68-4536-88e5-667f2ec548e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:29.392349 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d2823-7c68-4536-88e5-667f2ec548e1 None admin] PATH_INFO: `/v3/users` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:29.393297 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d2823-7c68-4536-88e5-667f2ec548e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:29.395107 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d2823-7c68-4536-88e5-667f2ec548e1 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:29.412478 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:29.421925 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 127/246] 10.222.0.15 () {60 vars in 1132 bytes} [Wed Aug 24 04:00:29 2022] POST /identity/v3/users => generated 293 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:00:29.423236 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d2823-7c68-4536-88e5-667f2ec548e1 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:29.459907 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe8ea9-4407-4b01-803f-89561cca0078 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:29.461473 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe8ea9-4407-4b01-803f-89561cca0078 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:29.591223 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 120/247] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 24 04:00:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:29.594617 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d2823-7c68-4536-88e5-667f2ec548e1 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:29.597099 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe8ea9-4407-4b01-803f-89561cca0078 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:29.619662 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:29.663263 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b2712-7e55-417e-9e4a-8b4a8e51bdac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:29.664153 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b2712-7e55-417e-9e4a-8b4a8e51bdac None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:29.664557 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b2712-7e55-417e-9e4a-8b4a8e51bdac None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:29.664932 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b2712-7e55-417e-9e4a-8b4a8e51bdac None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:29.665719 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b2712-7e55-417e-9e4a-8b4a8e51bdac None admin] RBAC: Adding query filter params (name=member) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:29.666120 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b2712-7e55-417e-9e4a-8b4a8e51bdac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:29.667730 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b2712-7e55-417e-9e4a-8b4a8e51bdac None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:29.682465 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 128/248] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 24 04:00:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:29.684002 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d73d21-1c1c-405d-a8f6-57f05165757c None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:29.684579 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d73d21-1c1c-405d-a8f6-57f05165757c None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:29.685062 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d73d21-1c1c-405d-a8f6-57f05165757c None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:29.687386 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 129/249] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:00:29.688533 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d73d21-1c1c-405d-a8f6-57f05165757c None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:29.711438 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:29.754629 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe8ea9-4407-4b01-803f-89561cca0078 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:29.801414 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4922e2f-6c07-43cf-be3f-5fc7c662323f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:29.802160 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4922e2f-6c07-43cf-be3f-5fc7c662323f None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:29.802469 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4922e2f-6c07-43cf-be3f-5fc7c662323f None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:29.802742 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4922e2f-6c07-43cf-be3f-5fc7c662323f None admin] PATH_INFO: `/v3/projects/8ecfc9b2a624461bb3d5c27fa0e48b9e` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:29.805709 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4922e2f-6c07-43cf-be3f-5fc7c662323f None admin] RBAC: Authorizing `identity:get_project(project_id=8ecfc9b2a624461bb3d5c27fa0e48b9e)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:29.807215 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4922e2f-6c07-43cf-be3f-5fc7c662323f None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:29.809316 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 121/250] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 24 04:00:29 2022] GET /identity/v3/projects/8ecfc9b2a624461bb3d5c27fa0e48b9e => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:00:29.811000 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d73d21-1c1c-405d-a8f6-57f05165757c None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:29.812239 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8020a4-719a-435f-91c5-1b7a13a751f7 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:29.812529 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8020a4-719a-435f-91c5-1b7a13a751f7 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:29.812804 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8020a4-719a-435f-91c5-1b7a13a751f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:29.832812 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-ef8020a4-719a-435f-91c5-1b7a13a751f7 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:29.834352 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-ef8020a4-719a-435f-91c5-1b7a13a751f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:29.856302 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc52c84-36a2-4555-9b6e-58e2f41b0ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:29.857015 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc52c84-36a2-4555-9b6e-58e2f41b0ca6 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:29.857390 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc52c84-36a2-4555-9b6e-58e2f41b0ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:29.857725 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc52c84-36a2-4555-9b6e-58e2f41b0ca6 None admin] PATH_INFO: `/v3/users/fe1e79cdae7145c8aa2f8de9dc78bfe8` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:29.858947 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc52c84-36a2-4555-9b6e-58e2f41b0ca6 None admin] RBAC: Authorizing `identity:get_user(user_id=fe1e79cdae7145c8aa2f8de9dc78bfe8)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:29.860846 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc52c84-36a2-4555-9b6e-58e2f41b0ca6 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:29.862541 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 130/251] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 24 04:00:29 2022] GET /identity/v3/users/fe1e79cdae7145c8aa2f8de9dc78bfe8 => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:29.863539 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc52c84-36a2-4555-9b6e-58e2f41b0ca6 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:29.912990 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:29.918733 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 122/252] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:00:29.920356 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8020a4-719a-435f-91c5-1b7a13a751f7 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:30.016919 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:30.029911 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc52c84-36a2-4555-9b6e-58e2f41b0ca6 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:30.070811 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8020a4-719a-435f-91c5-1b7a13a751f7 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:30.083443 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91154cf4-302f-4ebe-81b8-b8d2c5bee94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:30.084078 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91154cf4-302f-4ebe-81b8-b8d2c5bee94e None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:30.084361 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91154cf4-302f-4ebe-81b8-b8d2c5bee94e None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:30.084632 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91154cf4-302f-4ebe-81b8-b8d2c5bee94e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:30.085826 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91154cf4-302f-4ebe-81b8-b8d2c5bee94e None admin] RBAC: Adding query filter params (role.id=63bae148a6d14d6ca8cb30fca2851df5, scope.project.id=8ecfc9b2a624461bb3d5c27fa0e48b9e, user.id=38fbe685e070498897954547d94c867e) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:30.086138 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91154cf4-302f-4ebe-81b8-b8d2c5bee94e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:30.087689 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91154cf4-302f-4ebe-81b8-b8d2c5bee94e None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:30.094101 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 131/253] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 24 04:00:29 2022] GET /identity/v3/role_assignments?user.id=38fbe685e070498897954547d94c867e&scope.project.id=8ecfc9b2a624461bb3d5c27fa0e48b9e&role.id=63bae148a6d14d6ca8cb30fca2851df5 => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:30.105466 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64cb9f-9778-4c31-9201-d06c98c5e0c5 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:30.105780 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64cb9f-9778-4c31-9201-d06c98c5e0c5 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:30.106145 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64cb9f-9778-4c31-9201-d06c98c5e0c5 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:30.108302 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 132/254] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:00:30.114541 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f70b8b-a9b9-4414-8e6d-3d47a95d40d5 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:30.114865 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f70b8b-a9b9-4414-8e6d-3d47a95d40d5 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:30.115103 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f70b8b-a9b9-4414-8e6d-3d47a95d40d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:30.133083 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adddbc4e-d93b-473e-8406-e2186dfbcc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:30.133834 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddbc4e-d93b-473e-8406-e2186dfbcc10 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:30.134087 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddbc4e-d93b-473e-8406-e2186dfbcc10 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:30.134353 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddbc4e-d93b-473e-8406-e2186dfbcc10 None admin] PATH_INFO: `/v3/projects/8ecfc9b2a624461bb3d5c27fa0e48b9e` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:30.135865 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adddbc4e-d93b-473e-8406-e2186dfbcc10 None admin] RBAC: Authorizing `identity:get_project(project_id=8ecfc9b2a624461bb3d5c27fa0e48b9e)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:30.137390 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adddbc4e-d93b-473e-8406-e2186dfbcc10 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:30.139351 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 123/255] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 24 04:00:29 2022] GET /identity/v3/projects/8ecfc9b2a624461bb3d5c27fa0e48b9e => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:30.146993 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adddbc4e-d93b-473e-8406-e2186dfbcc10 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:30.149218 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-63f70b8b-a9b9-4414-8e6d-3d47a95d40d5 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:30.150916 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-63f70b8b-a9b9-4414-8e6d-3d47a95d40d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:30.246184 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 133/256] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 24 04:00:30.295031 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adddbc4e-d93b-473e-8406-e2186dfbcc10 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:30.330563 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:30.341778 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b808e4-967b-4c19-b503-f1bf063f96e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:30.342461 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b808e4-967b-4c19-b503-f1bf063f96e2 None admin] REQUEST_METHOD: `PUT` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:30.342736 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b808e4-967b-4c19-b503-f1bf063f96e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:30.343016 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b808e4-967b-4c19-b503-f1bf063f96e2 None admin] PATH_INFO: `/v3/projects/8ecfc9b2a624461bb3d5c27fa0e48b9e/users/fe1e79cdae7145c8aa2f8de9dc78bfe8/roles/5d03284e31284f60bcc99e4843279067` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:30.345030 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b808e4-967b-4c19-b503-f1bf063f96e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=8ecfc9b2a624461bb3d5c27fa0e48b9e, user_id=fe1e79cdae7145c8aa2f8de9dc78bfe8, role_id=5d03284e31284f60bcc99e4843279067)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:30.346579 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b808e4-967b-4c19-b503-f1bf063f96e2 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:30.361973 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 124/257] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Aug 24 04:00:30 2022] PUT /identity/v3/projects/8ecfc9b2a624461bb3d5c27fa0e48b9e/users/fe1e79cdae7145c8aa2f8de9dc78bfe8/roles/5d03284e31284f60bcc99e4843279067 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:00:30.430720 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f70b8b-a9b9-4414-8e6d-3d47a95d40d5 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:30.475349 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:30.569884 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f70b8b-a9b9-4414-8e6d-3d47a95d40d5 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:30.614874 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c812928-9394-4bec-bf77-60f514b44cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:30.615481 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c812928-9394-4bec-bf77-60f514b44cb5 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:30.615760 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c812928-9394-4bec-bf77-60f514b44cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:30.616030 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c812928-9394-4bec-bf77-60f514b44cb5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:30.627711 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c812928-9394-4bec-bf77-60f514b44cb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:00:30.632491 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-2c812928-9394-4bec-bf77-60f514b44cb5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:00:30.632491 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:00:30.632491 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:00:30.632491 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:00:30.632491 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:00:30.632491 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:00:30.632491 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:00:30.632491 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:00:30.632491 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:00:30.632491 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:00:30.632491 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:00:30.632491 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:00:30.632491 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:00:30.632491 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:00:30.632491 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:00:30.632491 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:00:30.634515 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:00:30.634515 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:00:30.634515 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:00:30.634515 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:00:30.634515 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:00:30.634515 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:00:30.634515 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:00:30.634515 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:00:30.634515 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:00:30.634515 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:00:30.634515 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:00:30.634515 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:00:30.634515 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:00:30.634515 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:00:30.634515 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:00:30.634515 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:00:30.636411 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:00:30.636411 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:00:30.636411 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:00:30.636411 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:00:30.636411 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:00:30.636411 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:00:30.636411 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:00:30.636411 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:00:30.636411 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:00:30.636411 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:00:30.636411 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:00:30.636411 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:00:30.636411 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 134/258] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Aug 24 04:00:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:00:30.641339 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b808e4-967b-4c19-b503-f1bf063f96e2 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:30.752499 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b808e4-967b-4c19-b503-f1bf063f96e2 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:30.790159 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cbb408-a5bb-4635-9bb2-96e9918943f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:30.790776 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbb408-a5bb-4635-9bb2-96e9918943f5 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:30.791052 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbb408-a5bb-4635-9bb2-96e9918943f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:30.791357 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbb408-a5bb-4635-9bb2-96e9918943f5 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:30.792035 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cbb408-a5bb-4635-9bb2-96e9918943f5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:30.792329 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cbb408-a5bb-4635-9bb2-96e9918943f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:30.793730 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cbb408-a5bb-4635-9bb2-96e9918943f5 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:30.807345 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 125/259] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 24 04:00:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:30.809187 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c812928-9394-4bec-bf77-60f514b44cb5 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:30.914447 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:30.925012 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c812928-9394-4bec-bf77-60f514b44cb5 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:30.966079 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69662883-0c37-44a1-a6b6-51599525f8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:30.966736 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69662883-0c37-44a1-a6b6-51599525f8d5 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:30.967013 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69662883-0c37-44a1-a6b6-51599525f8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:30.967348 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69662883-0c37-44a1-a6b6-51599525f8d5 None admin] PATH_INFO: `/v3/users/b67935aaec7e4f949a1ac5d84793c109` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:30.968576 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69662883-0c37-44a1-a6b6-51599525f8d5 None admin] RBAC: Authorizing `identity:get_user(user_id=b67935aaec7e4f949a1ac5d84793c109)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:30.970086 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69662883-0c37-44a1-a6b6-51599525f8d5 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:30.975350 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 135/260] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 24 04:00:30 2022] GET /identity/v3/users/b67935aaec7e4f949a1ac5d84793c109 => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:30.978078 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cbb408-a5bb-4635-9bb2-96e9918943f5 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:30.989189 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69662883-0c37-44a1-a6b6-51599525f8d5 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:31.110409 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69662883-0c37-44a1-a6b6-51599525f8d5 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:31.126475 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:31.151999 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77afc989-0e10-4520-b0e4-f0c8a2f9cc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:31.152910 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77afc989-0e10-4520-b0e4-f0c8a2f9cc6d None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:31.153196 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77afc989-0e10-4520-b0e4-f0c8a2f9cc6d None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:31.153467 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77afc989-0e10-4520-b0e4-f0c8a2f9cc6d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:31.165427 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77afc989-0e10-4520-b0e4-f0c8a2f9cc6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:00:31.170902 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-77afc989-0e10-4520-b0e4-f0c8a2f9cc6d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:00:31.170902 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:00:31.170902 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:00:31.170902 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:00:31.170902 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:00:31.170902 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:00:31.170902 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:00:31.170902 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:00:31.170902 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:00:31.170902 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:00:31.170902 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:00:31.170902 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:00:31.170902 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:00:31.170902 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:00:31.170902 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:00:31.170902 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:00:31.171867 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:00:31.171867 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:00:31.171867 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:00:31.171867 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:00:31.171867 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:00:31.171867 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:00:31.171867 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:00:31.171867 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:00:31.171867 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:00:31.171867 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:00:31.171867 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:00:31.171867 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:00:31.171867 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:00:31.171867 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:00:31.171867 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:00:31.171867 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:00:31.172633 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:00:31.172633 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:00:31.172633 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:00:31.172633 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:00:31.172633 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:00:31.172633 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:00:31.172633 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:00:31.172633 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:00:31.172633 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:00:31.172633 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:00:31.172633 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:00:31.172633 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:00:31.173277 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 136/261] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 24 04:00:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:00:31.179588 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77afc989-0e10-4520-b0e4-f0c8a2f9cc6d None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:31.248639 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cbb408-a5bb-4635-9bb2-96e9918943f5 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:31.259555 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:31.311317 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32adeb6-3a33-49f2-9f86-4ac9ba1a846f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:31.312019 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32adeb6-3a33-49f2-9f86-4ac9ba1a846f None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:31.312269 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32adeb6-3a33-49f2-9f86-4ac9ba1a846f None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:31.312543 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32adeb6-3a33-49f2-9f86-4ac9ba1a846f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:31.392675 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77afc989-0e10-4520-b0e4-f0c8a2f9cc6d None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:31.433340 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d77554-6533-4b81-a1b0-d6a11be94ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:31.433873 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d77554-6533-4b81-a1b0-d6a11be94ea9 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:31.434145 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d77554-6533-4b81-a1b0-d6a11be94ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:31.434412 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d77554-6533-4b81-a1b0-d6a11be94ea9 None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:31.435076 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d77554-6533-4b81-a1b0-d6a11be94ea9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:31.435400 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d77554-6533-4b81-a1b0-d6a11be94ea9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:31.436806 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d77554-6533-4b81-a1b0-d6a11be94ea9 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:31.452458 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 137/262] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 04:00:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:31.458174 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d77554-6533-4b81-a1b0-d6a11be94ea9 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:31.475232 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32adeb6-3a33-49f2-9f86-4ac9ba1a846f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:31.476750 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32adeb6-3a33-49f2-9f86-4ac9ba1a846f None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:31.598844 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:31.608854 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:31.656679 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d77554-6533-4b81-a1b0-d6a11be94ea9 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:31.707211 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 126/263] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 24 04:00:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 725 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:31.709290 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32adeb6-3a33-49f2-9f86-4ac9ba1a846f None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:31.723567 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6f106-c7e4-4556-9840-b92bb0a3752b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:31.724210 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6f106-c7e4-4556-9840-b92bb0a3752b None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:31.724486 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6f106-c7e4-4556-9840-b92bb0a3752b None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:31.724757 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6f106-c7e4-4556-9840-b92bb0a3752b None admin] PATH_INFO: `/v3/users/b67935aaec7e4f949a1ac5d84793c109` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:31.727779 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a6f106-c7e4-4556-9840-b92bb0a3752b None admin] RBAC: Authorizing `identity:get_user(user_id=b67935aaec7e4f949a1ac5d84793c109)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:31.730737 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a6f106-c7e4-4556-9840-b92bb0a3752b None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:31.732373 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 138/264] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 24 04:00:31 2022] GET /identity/v3/users/b67935aaec7e4f949a1ac5d84793c109 => generated 283 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:31.739169 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6f106-c7e4-4556-9840-b92bb0a3752b None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:31.870040 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32adeb6-3a33-49f2-9f86-4ac9ba1a846f None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:31.920744 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69605b04-9dc1-46dc-8537-1617275f08aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:31.921836 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69605b04-9dc1-46dc-8537-1617275f08aa None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:31.922318 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69605b04-9dc1-46dc-8537-1617275f08aa None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:31.922782 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69605b04-9dc1-46dc-8537-1617275f08aa None admin] PATH_INFO: `/v3/projects/8ecfc9b2a624461bb3d5c27fa0e48b9e` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:31.924550 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69605b04-9dc1-46dc-8537-1617275f08aa None admin] RBAC: Authorizing `identity:get_project(project_id=8ecfc9b2a624461bb3d5c27fa0e48b9e)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:31.927132 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69605b04-9dc1-46dc-8537-1617275f08aa None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:31.934876 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 127/265] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 24 04:00:31 2022] GET /identity/v3/projects/8ecfc9b2a624461bb3d5c27fa0e48b9e => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:31.940638 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69605b04-9dc1-46dc-8537-1617275f08aa None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:31.941562 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6f106-c7e4-4556-9840-b92bb0a3752b None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:31.980457 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:32.021009 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9bf90-a746-44cf-a4fe-a3c84534c38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:32.021636 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9bf90-a746-44cf-a4fe-a3c84534c38a None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:32.021912 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9bf90-a746-44cf-a4fe-a3c84534c38a None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:32.022242 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9bf90-a746-44cf-a4fe-a3c84534c38a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:32.053686 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:32.149620 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e9bf90-a746-44cf-a4fe-a3c84534c38a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:32.151289 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e9bf90-a746-44cf-a4fe-a3c84534c38a None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:32.201455 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69605b04-9dc1-46dc-8537-1617275f08aa None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:32.285829 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72313b12-2b08-4071-b2a9-83bd78ae1428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:32.286359 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72313b12-2b08-4071-b2a9-83bd78ae1428 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:32.286630 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72313b12-2b08-4071-b2a9-83bd78ae1428 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:32.286895 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72313b12-2b08-4071-b2a9-83bd78ae1428 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:32.287659 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72313b12-2b08-4071-b2a9-83bd78ae1428 None admin] RBAC: Adding query filter params (role.id=a9f3803644ca4a6fab51b9513141be7b, scope.project.id=8ecfc9b2a624461bb3d5c27fa0e48b9e, user.id=b67935aaec7e4f949a1ac5d84793c109) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:32.287961 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72313b12-2b08-4071-b2a9-83bd78ae1428 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:32.289410 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72313b12-2b08-4071-b2a9-83bd78ae1428 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:32.299915 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 128/266] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 24 04:00:31 2022] GET /identity/v3/role_assignments?user.id=b67935aaec7e4f949a1ac5d84793c109&scope.project.id=8ecfc9b2a624461bb3d5c27fa0e48b9e&role.id=a9f3803644ca4a6fab51b9513141be7b => generated 608 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:00:32.376219 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 139/267] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 24 04:00:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:32.382316 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72313b12-2b08-4071-b2a9-83bd78ae1428 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:32.508729 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:32.531397 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72313b12-2b08-4071-b2a9-83bd78ae1428 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:32.578618 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008dccfd-a603-4663-b342-9d2c0fb5746c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:32.579304 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008dccfd-a603-4663-b342-9d2c0fb5746c None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:32.579579 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008dccfd-a603-4663-b342-9d2c0fb5746c None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:32.579843 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008dccfd-a603-4663-b342-9d2c0fb5746c None admin] PATH_INFO: `/v3/projects/8ecfc9b2a624461bb3d5c27fa0e48b9e` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:32.584123 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008dccfd-a603-4663-b342-9d2c0fb5746c None admin] RBAC: Authorizing `identity:get_project(project_id=8ecfc9b2a624461bb3d5c27fa0e48b9e)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:32.585642 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008dccfd-a603-4663-b342-9d2c0fb5746c None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:32.587844 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 129/268] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 24 04:00:32 2022] GET /identity/v3/projects/8ecfc9b2a624461bb3d5c27fa0e48b9e => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:32.593515 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9bf90-a746-44cf-a4fe-a3c84534c38a None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:32.678138 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:32.732220 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9bf90-a746-44cf-a4fe-a3c84534c38a None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:32.777603 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d81979-fe96-4e84-ad08-1917f79d7328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:32.778274 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d81979-fe96-4e84-ad08-1917f79d7328 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:32.778555 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d81979-fe96-4e84-ad08-1917f79d7328 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:32.778826 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d81979-fe96-4e84-ad08-1917f79d7328 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:32.779655 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d81979-fe96-4e84-ad08-1917f79d7328 None admin] RBAC: Adding query filter params (role.id=df6a8bb215d54f71a0b6988a9c01f5e4, scope.project.id=8ecfc9b2a624461bb3d5c27fa0e48b9e, user.id=b67935aaec7e4f949a1ac5d84793c109) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:32.779959 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d81979-fe96-4e84-ad08-1917f79d7328 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:32.781420 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d81979-fe96-4e84-ad08-1917f79d7328 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:32.792222 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 140/269] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 24 04:00:32 2022] GET /identity/v3/role_assignments?user.id=b67935aaec7e4f949a1ac5d84793c109&scope.project.id=8ecfc9b2a624461bb3d5c27fa0e48b9e&role.id=df6a8bb215d54f71a0b6988a9c01f5e4 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:33.219888 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf61b20-512a-4d7d-8324-4b58d72684b8 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:33.220106 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf61b20-512a-4d7d-8324-4b58d72684b8 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:33.220351 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf61b20-512a-4d7d-8324-4b58d72684b8 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:33.222158 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 130/270] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:00:33.229201 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f04a53-ccae-4b01-b3ff-7010e3ba6f6a None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:33.229699 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f04a53-ccae-4b01-b3ff-7010e3ba6f6a None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:33.230108 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f04a53-ccae-4b01-b3ff-7010e3ba6f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:33.251111 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-57f04a53-ccae-4b01-b3ff-7010e3ba6f6a None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:33.252561 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-57f04a53-ccae-4b01-b3ff-7010e3ba6f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:33.263229 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d31eaf-dcaa-49a6-9688-6aeb1d52fec6 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:33.263533 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d31eaf-dcaa-49a6-9688-6aeb1d52fec6 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:33.263777 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d31eaf-dcaa-49a6-9688-6aeb1d52fec6 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:33.265320 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 131/271] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:00:33.271245 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dec589-61cd-4177-a7e2-fccfec3411e2 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:33.271848 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dec589-61cd-4177-a7e2-fccfec3411e2 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:33.272311 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dec589-61cd-4177-a7e2-fccfec3411e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:33.294286 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-97dec589-61cd-4177-a7e2-fccfec3411e2 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:33.295587 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-97dec589-61cd-4177-a7e2-fccfec3411e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:33.343180 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 141/272] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:00:33.345546 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afbc83-182d-4875-ad0a-c366fed17c43 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:33.346057 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afbc83-182d-4875-ad0a-c366fed17c43 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:33.346523 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afbc83-182d-4875-ad0a-c366fed17c43 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:33.348076 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 142/273] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:00:33.354539 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39271b3-6eee-4ab9-8c75-c41f1bdb4959 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:33.354862 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39271b3-6eee-4ab9-8c75-c41f1bdb4959 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:33.355298 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39271b3-6eee-4ab9-8c75-c41f1bdb4959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:33.378961 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-e39271b3-6eee-4ab9-8c75-c41f1bdb4959 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:33.381171 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-e39271b3-6eee-4ab9-8c75-c41f1bdb4959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:33.403391 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 132/274] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:00:33.429637 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:33.459766 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 143/275] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:00:33.560217 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569638e-2a57-4709-8f29-6ae837bc1c98 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:33.560514 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569638e-2a57-4709-8f29-6ae837bc1c98 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:33.560672 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569638e-2a57-4709-8f29-6ae837bc1c98 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:33.562178 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 133/276] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:00:33.567582 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c32adf-54d3-4076-993a-bfd08c4fb182 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:33.567865 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c32adf-54d3-4076-993a-bfd08c4fb182 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:33.568136 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c32adf-54d3-4076-993a-bfd08c4fb182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:33.587747 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-b9c32adf-54d3-4076-993a-bfd08c4fb182 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:33.588952 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-b9c32adf-54d3-4076-993a-bfd08c4fb182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:33.664414 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 144/277] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:00:33.708902 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569638e-2a57-4709-8f29-6ae837bc1c98 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:33.757680 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c32adf-54d3-4076-993a-bfd08c4fb182 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:33.812460 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:33.834107 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569638e-2a57-4709-8f29-6ae837bc1c98 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:33.883849 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c32adf-54d3-4076-993a-bfd08c4fb182 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:33.887160 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:33.893724 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765a832-11e8-4968-bb4c-c261cddb7396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:33.893724 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765a832-11e8-4968-bb4c-c261cddb7396 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:33.893724 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765a832-11e8-4968-bb4c-c261cddb7396 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:33.893724 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765a832-11e8-4968-bb4c-c261cddb7396 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:33.911813 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c765a832-11e8-4968-bb4c-c261cddb7396 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:00:33.919477 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-c765a832-11e8-4968-bb4c-c261cddb7396 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:00:33.919477 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:00:33.919477 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:00:33.919477 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:00:33.919477 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:00:33.919477 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:00:33.919477 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:00:33.919477 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:00:33.919477 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:00:33.919477 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:00:33.919477 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:00:33.919477 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:00:33.919477 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:00:33.919477 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:00:33.919477 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:00:33.919477 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:00:33.920831 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:00:33.920831 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:00:33.920831 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:00:33.920831 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:00:33.920831 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:00:33.920831 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:00:33.920831 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:00:33.920831 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:00:33.920831 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:00:33.920831 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:00:33.920831 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:00:33.920831 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:00:33.920831 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:00:33.920831 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:00:33.920831 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:00:33.920831 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:00:33.922355 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:00:33.922355 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:00:33.922355 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:00:33.922355 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:00:33.922355 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:00:33.922355 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:00:33.922355 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:00:33.922355 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:00:33.922355 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:00:33.922355 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:00:33.922355 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:00:33.922355 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:00:33.922355 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 134/278] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 04:00:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:00:33.922355 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765a832-11e8-4968-bb4c-c261cddb7396 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:33.933559 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03c38b-2bee-40bd-9c1d-febd02306b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:33.934305 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03c38b-2bee-40bd-9c1d-febd02306b8a None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:33.934676 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03c38b-2bee-40bd-9c1d-febd02306b8a None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:33.935001 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03c38b-2bee-40bd-9c1d-febd02306b8a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:33.948749 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f03c38b-2bee-40bd-9c1d-febd02306b8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:00:33.953454 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-2f03c38b-2bee-40bd-9c1d-febd02306b8a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:00:33.953454 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:00:33.953454 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:00:33.953454 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:00:33.953454 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:00:33.953454 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:00:33.953454 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:00:33.953454 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:00:33.953454 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:00:33.953454 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:00:33.953454 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:00:33.953454 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:00:33.953454 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:00:33.953454 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:00:33.953454 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:00:33.953454 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:00:33.955674 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:00:33.955674 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:00:33.955674 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:00:33.955674 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:00:33.955674 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:00:33.955674 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:00:33.955674 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:00:33.955674 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:00:33.955674 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:00:33.955674 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:00:33.955674 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:00:33.955674 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:00:33.955674 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:00:33.955674 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:00:33.955674 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:00:33.955674 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:00:33.956462 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:00:33.956462 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:00:33.956462 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:00:33.956462 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:00:33.956462 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:00:33.956462 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:00:33.956462 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:00:33.956462 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:00:33.956462 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:00:33.956462 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:00:33.956462 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:00:33.956462 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:00:33.956462 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 145/279] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 04:00:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:00:33.956462 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03c38b-2bee-40bd-9c1d-febd02306b8a None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:34.039626 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765a832-11e8-4968-bb4c-c261cddb7396 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:34.069334 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03c38b-2bee-40bd-9c1d-febd02306b8a None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:34.076015 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30554af4-67c5-4dda-bd21-425a61602de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:34.076665 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30554af4-67c5-4dda-bd21-425a61602de0 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:34.076928 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30554af4-67c5-4dda-bd21-425a61602de0 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:34.077200 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30554af4-67c5-4dda-bd21-425a61602de0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:34.078341 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30554af4-67c5-4dda-bd21-425a61602de0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:34.079865 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30554af4-67c5-4dda-bd21-425a61602de0 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:34.081441 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 135/280] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:00:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:34.082205 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30554af4-67c5-4dda-bd21-425a61602de0 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:34.093108 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:34.109203 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625c248-b77a-4fe9-9ded-ec18fc1f2f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:34.109812 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625c248-b77a-4fe9-9ded-ec18fc1f2f88 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:34.110089 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625c248-b77a-4fe9-9ded-ec18fc1f2f88 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:34.110362 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625c248-b77a-4fe9-9ded-ec18fc1f2f88 None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:34.111007 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625c248-b77a-4fe9-9ded-ec18fc1f2f88 None admin] RBAC: Adding query filter params (name=member) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:34.111343 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625c248-b77a-4fe9-9ded-ec18fc1f2f88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:34.112750 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625c248-b77a-4fe9-9ded-ec18fc1f2f88 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:34.122235 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 146/281] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 24 04:00:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:34.124527 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625c248-b77a-4fe9-9ded-ec18fc1f2f88 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:34.157959 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:34.189972 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30554af4-67c5-4dda-bd21-425a61602de0 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:34.228540 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89dd23-5f46-4262-87e7-e35de1481b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:34.229159 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89dd23-5f46-4262-87e7-e35de1481b73 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:34.229436 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89dd23-5f46-4262-87e7-e35de1481b73 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:34.229707 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89dd23-5f46-4262-87e7-e35de1481b73 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:34.230376 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89dd23-5f46-4262-87e7-e35de1481b73 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:34.230678 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89dd23-5f46-4262-87e7-e35de1481b73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:34.232106 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89dd23-5f46-4262-87e7-e35de1481b73 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:34.235576 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625c248-b77a-4fe9-9ded-ec18fc1f2f88 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:34.241130 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 136/282] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 24 04:00:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:34.242001 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89dd23-5f46-4262-87e7-e35de1481b73 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:34.272676 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1a069-048f-48cd-93f1-85a418beb265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:34.273321 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1a069-048f-48cd-93f1-85a418beb265 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:34.273602 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1a069-048f-48cd-93f1-85a418beb265 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:34.273933 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1a069-048f-48cd-93f1-85a418beb265 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:34.284782 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1a069-048f-48cd-93f1-85a418beb265 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:00:34.290066 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-b9a1a069-048f-48cd-93f1-85a418beb265 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:00:34.290066 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:00:34.290066 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:00:34.290066 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:00:34.290066 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:00:34.290066 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:00:34.290066 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:00:34.290066 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:00:34.290066 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:00:34.290066 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:00:34.290066 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:00:34.290066 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:00:34.290066 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:00:34.290066 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:00:34.290066 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:00:34.290066 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:00:34.290965 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:00:34.290965 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:00:34.290965 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:00:34.290965 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:00:34.290965 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:00:34.290965 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:00:34.290965 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:00:34.290965 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:00:34.290965 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:00:34.290965 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:00:34.290965 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:00:34.290965 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:00:34.290965 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:00:34.290965 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:00:34.290965 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:00:34.290965 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:00:34.292102 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:00:34.292102 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:00:34.292102 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:00:34.292102 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:00:34.292102 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:00:34.292102 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:00:34.292102 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:00:34.292102 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:00:34.292102 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:00:34.292102 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:00:34.292102 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:00:34.292102 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:00:34.292102 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 147/283] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 04:00:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:00:34.292102 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1a069-048f-48cd-93f1-85a418beb265 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:34.317979 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:34.362947 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89dd23-5f46-4262-87e7-e35de1481b73 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:34.383291 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:34.399898 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1a069-048f-48cd-93f1-85a418beb265 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:34.411797 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee49191-7ae4-4ea2-83f1-5cf9db7b0380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:34.412472 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee49191-7ae4-4ea2-83f1-5cf9db7b0380 None admin] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:34.412752 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee49191-7ae4-4ea2-83f1-5cf9db7b0380 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:34.413018 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee49191-7ae4-4ea2-83f1-5cf9db7b0380 None admin] PATH_INFO: `/v3/users` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:34.413679 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee49191-7ae4-4ea2-83f1-5cf9db7b0380 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:34.415182 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee49191-7ae4-4ea2-83f1-5cf9db7b0380 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:34.438141 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3150e44-e5bd-402d-bce8-9e16f7513d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:34.438705 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 137/284] 10.222.0.15 () {60 vars in 1132 bytes} [Wed Aug 24 04:00:34 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:00:34.438810 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3150e44-e5bd-402d-bce8-9e16f7513d6f None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:34.439041 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3150e44-e5bd-402d-bce8-9e16f7513d6f None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:34.439348 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3150e44-e5bd-402d-bce8-9e16f7513d6f None admin] PATH_INFO: `/v3/users/6ab2e89614e74e5090684514d1f19cae` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:34.439615 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee49191-7ae4-4ea2-83f1-5cf9db7b0380 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:34.455845 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3150e44-e5bd-402d-bce8-9e16f7513d6f None admin] RBAC: Authorizing `identity:get_user(user_id=6ab2e89614e74e5090684514d1f19cae)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:34.457432 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3150e44-e5bd-402d-bce8-9e16f7513d6f None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:34.464530 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 148/285] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 24 04:00:34 2022] GET /identity/v3/users/6ab2e89614e74e5090684514d1f19cae => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:34.464530 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3150e44-e5bd-402d-bce8-9e16f7513d6f None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:34.580661 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee49191-7ae4-4ea2-83f1-5cf9db7b0380 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:34.586534 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3150e44-e5bd-402d-bce8-9e16f7513d6f None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:34.612205 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:34.626321 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0676d52-d77f-4af4-8566-486b6ca255a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:34.627611 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0676d52-d77f-4af4-8566-486b6ca255a5 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:34.627611 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0676d52-d77f-4af4-8566-486b6ca255a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:34.627611 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0676d52-d77f-4af4-8566-486b6ca255a5 None admin] PATH_INFO: `/v3/users/38fbe685e070498897954547d94c867e` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:34.628605 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0676d52-d77f-4af4-8566-486b6ca255a5 None admin] RBAC: Authorizing `identity:get_user(user_id=38fbe685e070498897954547d94c867e)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:34.630070 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0676d52-d77f-4af4-8566-486b6ca255a5 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:34.631406 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a18c8-d47d-48a4-a443-b644aba6c312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:34.631872 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 138/286] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 24 04:00:34 2022] GET /identity/v3/users/38fbe685e070498897954547d94c867e => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:34.631996 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a18c8-d47d-48a4-a443-b644aba6c312 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:34.632280 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a18c8-d47d-48a4-a443-b644aba6c312 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:34.632468 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0676d52-d77f-4af4-8566-486b6ca255a5 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:34.632573 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a18c8-d47d-48a4-a443-b644aba6c312 None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:34.633361 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a18c8-d47d-48a4-a443-b644aba6c312 None admin] RBAC: Adding query filter params (name=member) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:34.633661 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a18c8-d47d-48a4-a443-b644aba6c312 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:34.635034 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a18c8-d47d-48a4-a443-b644aba6c312 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:34.655079 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 149/287] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 24 04:00:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:34.655079 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a18c8-d47d-48a4-a443-b644aba6c312 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:34.657375 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:34.779745 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0676d52-d77f-4af4-8566-486b6ca255a5 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:34.785230 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a18c8-d47d-48a4-a443-b644aba6c312 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:34.823833 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826bbd8-9e49-4810-a636-c273c5d25fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:34.824476 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826bbd8-9e49-4810-a636-c273c5d25fb9 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:34.824759 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826bbd8-9e49-4810-a636-c273c5d25fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:34.825194 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826bbd8-9e49-4810-a636-c273c5d25fb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:34.826288 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7826bbd8-9e49-4810-a636-c273c5d25fb9 None admin] RBAC: Adding query filter params (role.id=5d03284e31284f60bcc99e4843279067, user.id=6ab2e89614e74e5090684514d1f19cae, scope.system=all) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:34.826872 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7826bbd8-9e49-4810-a636-c273c5d25fb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:34.828401 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7826bbd8-9e49-4810-a636-c273c5d25fb9 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:34.830679 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908950e0-a12e-49ca-909d-0a61bbf4baba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:34.831797 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908950e0-a12e-49ca-909d-0a61bbf4baba None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:34.832082 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908950e0-a12e-49ca-909d-0a61bbf4baba None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:34.833620 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908950e0-a12e-49ca-909d-0a61bbf4baba None admin] PATH_INFO: `/v3/projects/8ecfc9b2a624461bb3d5c27fa0e48b9e` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:34.840296 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 139/288] 10.222.0.15 () {56 vars in 1308 bytes} [Wed Aug 24 04:00:34 2022] GET /identity/v3/role_assignments?user.id=6ab2e89614e74e5090684514d1f19cae&scope.system=all&role.id=5d03284e31284f60bcc99e4843279067 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:34.840523 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908950e0-a12e-49ca-909d-0a61bbf4baba None admin] RBAC: Authorizing `identity:get_project(project_id=8ecfc9b2a624461bb3d5c27fa0e48b9e)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:34.840631 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826bbd8-9e49-4810-a636-c273c5d25fb9 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:34.840716 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908950e0-a12e-49ca-909d-0a61bbf4baba None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:34.840716 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 150/289] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 24 04:00:34 2022] GET /identity/v3/projects/8ecfc9b2a624461bb3d5c27fa0e48b9e => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:34.845674 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908950e0-a12e-49ca-909d-0a61bbf4baba None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:34.956277 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:34.963611 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:35.019917 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908950e0-a12e-49ca-909d-0a61bbf4baba None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:35.061798 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f101b-3e44-4bee-9b82-54a58f9433ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:35.062482 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f101b-3e44-4bee-9b82-54a58f9433ac None admin] REQUEST_METHOD: `PUT` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:35.062764 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f101b-3e44-4bee-9b82-54a58f9433ac None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:35.063155 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f101b-3e44-4bee-9b82-54a58f9433ac None admin] PATH_INFO: `/v3/projects/8ecfc9b2a624461bb3d5c27fa0e48b9e/users/38fbe685e070498897954547d94c867e/roles/63bae148a6d14d6ca8cb30fca2851df5` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:35.066673 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f101b-3e44-4bee-9b82-54a58f9433ac None admin] RBAC: Authorizing `identity:create_grant(project_id=8ecfc9b2a624461bb3d5c27fa0e48b9e, user_id=38fbe685e070498897954547d94c867e, role_id=63bae148a6d14d6ca8cb30fca2851df5)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:35.066812 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f101b-3e44-4bee-9b82-54a58f9433ac None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:35.080721 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826bbd8-9e49-4810-a636-c273c5d25fb9 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:35.085272 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 151/290] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Aug 24 04:00:34 2022] PUT /identity/v3/projects/8ecfc9b2a624461bb3d5c27fa0e48b9e/users/38fbe685e070498897954547d94c867e/roles/63bae148a6d14d6ca8cb30fca2851df5 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:00:35.130690 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212e1777-11de-4f30-978a-e0e44230ba51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:35.131497 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e1777-11de-4f30-978a-e0e44230ba51 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:35.131808 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e1777-11de-4f30-978a-e0e44230ba51 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:35.132082 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e1777-11de-4f30-978a-e0e44230ba51 None admin] PATH_INFO: `/v3/users/fe1e79cdae7145c8aa2f8de9dc78bfe8` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:35.133751 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212e1777-11de-4f30-978a-e0e44230ba51 None admin] RBAC: Authorizing `identity:get_user(user_id=fe1e79cdae7145c8aa2f8de9dc78bfe8)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:35.135413 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212e1777-11de-4f30-978a-e0e44230ba51 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:35.137558 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 140/291] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 24 04:00:34 2022] GET /identity/v3/users/fe1e79cdae7145c8aa2f8de9dc78bfe8 => generated 297 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:35.144614 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f101b-3e44-4bee-9b82-54a58f9433ac None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:35.266370 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f101b-3e44-4bee-9b82-54a58f9433ac None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:35.303618 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c35250-a138-4360-bfda-5055ed65d7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:35.304275 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c35250-a138-4360-bfda-5055ed65d7dc None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:35.304553 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c35250-a138-4360-bfda-5055ed65d7dc None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:35.304828 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c35250-a138-4360-bfda-5055ed65d7dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:35.308534 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:35.383643 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c35250-a138-4360-bfda-5055ed65d7dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:35.385185 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c35250-a138-4360-bfda-5055ed65d7dc None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:35.519003 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 152/292] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 24 04:00:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:35.527628 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212e1777-11de-4f30-978a-e0e44230ba51 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:35.679168 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212e1777-11de-4f30-978a-e0e44230ba51 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:35.734982 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:35.754827 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f685ab-bf98-4999-80ca-cd6c02680bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:35.755991 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f685ab-bf98-4999-80ca-cd6c02680bdb None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:35.756462 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f685ab-bf98-4999-80ca-cd6c02680bdb None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:35.756927 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f685ab-bf98-4999-80ca-cd6c02680bdb None admin] PATH_INFO: `/v3/projects/8ecfc9b2a624461bb3d5c27fa0e48b9e` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:35.764547 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f685ab-bf98-4999-80ca-cd6c02680bdb None admin] RBAC: Authorizing `identity:get_project(project_id=8ecfc9b2a624461bb3d5c27fa0e48b9e)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:35.767333 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f685ab-bf98-4999-80ca-cd6c02680bdb None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:35.770494 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 141/293] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 24 04:00:35 2022] GET /identity/v3/projects/8ecfc9b2a624461bb3d5c27fa0e48b9e => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:35.777256 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c35250-a138-4360-bfda-5055ed65d7dc None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:35.868328 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:35.968023 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c35250-a138-4360-bfda-5055ed65d7dc None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:36.018725 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2548f69c-6713-41d8-b358-a6b408cc8a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:36.019367 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2548f69c-6713-41d8-b358-a6b408cc8a01 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:36.019654 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2548f69c-6713-41d8-b358-a6b408cc8a01 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:36.019931 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2548f69c-6713-41d8-b358-a6b408cc8a01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:36.020722 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2548f69c-6713-41d8-b358-a6b408cc8a01 None admin] RBAC: Adding query filter params (role.id=5d03284e31284f60bcc99e4843279067, scope.project.id=8ecfc9b2a624461bb3d5c27fa0e48b9e, user.id=fe1e79cdae7145c8aa2f8de9dc78bfe8) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:36.020978 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2548f69c-6713-41d8-b358-a6b408cc8a01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:36.022437 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2548f69c-6713-41d8-b358-a6b408cc8a01 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:36.029185 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 153/294] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 24 04:00:35 2022] GET /identity/v3/role_assignments?user.id=fe1e79cdae7145c8aa2f8de9dc78bfe8&scope.project.id=8ecfc9b2a624461bb3d5c27fa0e48b9e&role.id=5d03284e31284f60bcc99e4843279067 => generated 608 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:36.964938 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9f290-9847-44ac-b4c9-ef79c5e2d709 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:36.965937 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9f290-9847-44ac-b4c9-ef79c5e2d709 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:36.966408 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9f290-9847-44ac-b4c9-ef79c5e2d709 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:36.968342 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 142/295] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:00:36.974297 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43d6ff-f2d6-452a-8b4e-bbbe74fcd0fd None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:36.975455 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43d6ff-f2d6-452a-8b4e-bbbe74fcd0fd None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:36.975949 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43d6ff-f2d6-452a-8b4e-bbbe74fcd0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:36.995010 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-df43d6ff-f2d6-452a-8b4e-bbbe74fcd0fd None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:36.996659 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-df43d6ff-f2d6-452a-8b4e-bbbe74fcd0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:37.067892 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 154/296] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:00:37.369373 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d181e8-97f0-4a31-87cf-189a43bbe9ef None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:37.370189 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d181e8-97f0-4a31-87cf-189a43bbe9ef None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:37.370672 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d181e8-97f0-4a31-87cf-189a43bbe9ef None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:37.372538 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 143/297] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:00:37.380176 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b9cd7-261c-4c97-b076-3b7662d58648 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:37.380942 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b9cd7-261c-4c97-b076-3b7662d58648 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:37.381484 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b9cd7-261c-4c97-b076-3b7662d58648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:37.403374 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-d96b9cd7-261c-4c97-b076-3b7662d58648 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:37.404990 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-d96b9cd7-261c-4c97-b076-3b7662d58648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:37.423291 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d181e8-97f0-4a31-87cf-189a43bbe9ef None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:37.433417 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:37.491693 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 155/298] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:00:37.503871 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f2be5-b5f4-4f4d-b4a6-1c824b24d0ca None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:37.504214 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f2be5-b5f4-4f4d-b4a6-1c824b24d0ca None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:37.504564 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f2be5-b5f4-4f4d-b4a6-1c824b24d0ca None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:37.507225 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 156/299] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:00:37.513701 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b52831-b241-4286-bf32-27afc9c8c188 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:37.514341 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b52831-b241-4286-bf32-27afc9c8c188 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:37.514816 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b52831-b241-4286-bf32-27afc9c8c188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:37.541417 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-14b52831-b241-4286-bf32-27afc9c8c188 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:37.543636 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-14b52831-b241-4286-bf32-27afc9c8c188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:37.566765 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d181e8-97f0-4a31-87cf-189a43bbe9ef None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:37.615530 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d63fa-8cb5-4d1a-a64a-859f29ff6728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:37.616566 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d63fa-8cb5-4d1a-a64a-859f29ff6728 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:37.617434 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d63fa-8cb5-4d1a-a64a-859f29ff6728 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:37.617906 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d63fa-8cb5-4d1a-a64a-859f29ff6728 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:37.632229 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d63fa-8cb5-4d1a-a64a-859f29ff6728 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:00:37.639592 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-393d63fa-8cb5-4d1a-a64a-859f29ff6728 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:00:37.639592 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:00:37.639592 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:00:37.639592 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:00:37.639592 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:00:37.639592 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:00:37.639592 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:00:37.639592 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:00:37.639592 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:00:37.639592 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:00:37.639592 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:00:37.639592 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:00:37.639592 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:00:37.639592 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:00:37.639592 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:00:37.639592 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:00:37.640530 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:00:37.640530 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:00:37.640530 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:00:37.640530 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:00:37.640530 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:00:37.640530 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:00:37.640530 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:00:37.640530 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:00:37.640530 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:00:37.640530 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:00:37.640530 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:00:37.640530 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:00:37.640530 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:00:37.640530 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:00:37.640530 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:00:37.640530 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:00:37.641325 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:00:37.641325 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:00:37.641325 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:00:37.641325 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:00:37.641325 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:00:37.641325 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:00:37.641325 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:00:37.641325 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:00:37.641325 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:00:37.641325 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:00:37.641325 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:00:37.641325 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:00:37.643694 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 144/300] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 04:00:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:00:37.651659 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 157/301] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:00:37.652944 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d63fa-8cb5-4d1a-a64a-859f29ff6728 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:37.722786 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:37.771579 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d63fa-8cb5-4d1a-a64a-859f29ff6728 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:37.808634 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad4955-c2b3-4f86-ba92-ebb7055a736f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:37.809554 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad4955-c2b3-4f86-ba92-ebb7055a736f None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:37.810029 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad4955-c2b3-4f86-ba92-ebb7055a736f None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:37.810485 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad4955-c2b3-4f86-ba92-ebb7055a736f None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:37.811362 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad4955-c2b3-4f86-ba92-ebb7055a736f None admin] RBAC: Adding query filter params (name=reader) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:37.811835 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad4955-c2b3-4f86-ba92-ebb7055a736f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:37.813462 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad4955-c2b3-4f86-ba92-ebb7055a736f None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:37.823819 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 145/302] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 24 04:00:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:37.829765 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b52831-b241-4286-bf32-27afc9c8c188 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:37.848098 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad4955-c2b3-4f86-ba92-ebb7055a736f None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:37.967831 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:37.970551 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad4955-c2b3-4f86-ba92-ebb7055a736f None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:37.988290 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b52831-b241-4286-bf32-27afc9c8c188 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:37.989742 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:38.013055 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6fa13-da2d-4a95-af24-a4a4a07f88f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:38.013898 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6fa13-da2d-4a95-af24-a4a4a07f88f3 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:38.014215 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6fa13-da2d-4a95-af24-a4a4a07f88f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:38.014621 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6fa13-da2d-4a95-af24-a4a4a07f88f3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:38.029559 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f6fa13-da2d-4a95-af24-a4a4a07f88f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:00:38.036827 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-49f6fa13-da2d-4a95-af24-a4a4a07f88f3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:00:38.036827 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:00:38.036827 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:00:38.036827 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:00:38.036827 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:00:38.036827 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:00:38.036827 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:00:38.036827 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:00:38.036827 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:00:38.036827 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:00:38.036827 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:00:38.036827 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:00:38.036827 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:00:38.036827 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:00:38.036827 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:00:38.036827 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:00:38.038015 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:00:38.038015 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:00:38.038015 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:00:38.038015 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:00:38.038015 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:00:38.038015 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:00:38.038015 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:00:38.038015 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:00:38.038015 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:00:38.038015 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:00:38.038015 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:00:38.038015 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:00:38.038015 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:00:38.038015 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:00:38.038015 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:00:38.038015 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:00:38.038794 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:00:38.038794 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:00:38.038794 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:00:38.038794 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:00:38.038794 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:00:38.038794 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:00:38.038794 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:00:38.038794 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:00:38.038794 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:00:38.038794 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:00:38.038794 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:00:38.038794 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:00:38.038794 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 146/303] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 04:00:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:00:38.040230 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6fa13-da2d-4a95-af24-a4a4a07f88f3 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:38.047709 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be988dbc-f0fb-473f-9bf5-42d85b0c83a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:38.048454 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be988dbc-f0fb-473f-9bf5-42d85b0c83a1 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:38.048879 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be988dbc-f0fb-473f-9bf5-42d85b0c83a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:38.049234 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be988dbc-f0fb-473f-9bf5-42d85b0c83a1 None admin] PATH_INFO: `/v3/users/603b4e9409d34f6c9eff67feb91bccb2` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:38.068273 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be988dbc-f0fb-473f-9bf5-42d85b0c83a1 None admin] RBAC: Authorizing `identity:get_user(user_id=603b4e9409d34f6c9eff67feb91bccb2)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:38.070134 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be988dbc-f0fb-473f-9bf5-42d85b0c83a1 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:38.078829 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 158/304] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 24 04:00:37 2022] GET /identity/v3/users/603b4e9409d34f6c9eff67feb91bccb2 => generated 293 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:38.078829 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be988dbc-f0fb-473f-9bf5-42d85b0c83a1 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:38.181201 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6fa13-da2d-4a95-af24-a4a4a07f88f3 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:38.199668 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be988dbc-f0fb-473f-9bf5-42d85b0c83a1 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:38.228359 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47724c6-fc59-40ee-9912-2558804a0f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:38.229050 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47724c6-fc59-40ee-9912-2558804a0f35 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:38.229379 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47724c6-fc59-40ee-9912-2558804a0f35 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:38.229741 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47724c6-fc59-40ee-9912-2558804a0f35 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:38.230912 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47724c6-fc59-40ee-9912-2558804a0f35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:38.232618 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47724c6-fc59-40ee-9912-2558804a0f35 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:38.234451 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 147/305] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:00:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:38.235232 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47724c6-fc59-40ee-9912-2558804a0f35 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:38.237231 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ebd91e-dbec-42a4-b7c5-35718f5ddf42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:38.237842 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebd91e-dbec-42a4-b7c5-35718f5ddf42 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:38.238129 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebd91e-dbec-42a4-b7c5-35718f5ddf42 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:38.238405 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebd91e-dbec-42a4-b7c5-35718f5ddf42 None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:38.239081 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ebd91e-dbec-42a4-b7c5-35718f5ddf42 None admin] RBAC: Adding query filter params (name=member) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:38.239413 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ebd91e-dbec-42a4-b7c5-35718f5ddf42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:38.240809 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ebd91e-dbec-42a4-b7c5-35718f5ddf42 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:38.249861 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 159/306] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 24 04:00:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:38.255183 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc734502-6646-440f-84ae-0eb180da2d6e None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:38.255183 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc734502-6646-440f-84ae-0eb180da2d6e None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:38.255183 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc734502-6646-440f-84ae-0eb180da2d6e None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:38.255183 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 160/307] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:00:38.255183 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc734502-6646-440f-84ae-0eb180da2d6e None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:38.266762 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:38.307935 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:38.387528 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc734502-6646-440f-84ae-0eb180da2d6e None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:38.394067 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47724c6-fc59-40ee-9912-2558804a0f35 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:38.430194 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f28da-5b00-4397-89eb-d304c64f6732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:38.430820 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f28da-5b00-4397-89eb-d304c64f6732 None admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:38.431095 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f28da-5b00-4397-89eb-d304c64f6732 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:38.431455 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f28da-5b00-4397-89eb-d304c64f6732 None admin] PATH_INFO: `/v3/groups` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:38.432136 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f28da-5b00-4397-89eb-d304c64f6732 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:38.433674 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f28da-5b00-4397-89eb-d304c64f6732 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:38.447033 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e48c9-e2dc-4dd5-8f18-4960387c6215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:38.447737 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e48c9-e2dc-4dd5-8f18-4960387c6215 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:38.447984 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e48c9-e2dc-4dd5-8f18-4960387c6215 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:38.448252 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e48c9-e2dc-4dd5-8f18-4960387c6215 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:38.449008 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e48c9-e2dc-4dd5-8f18-4960387c6215 None admin] RBAC: Adding query filter params (role.id=63bae148a6d14d6ca8cb30fca2851df5, user.id=603b4e9409d34f6c9eff67feb91bccb2, scope.system=all) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:38.449301 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e48c9-e2dc-4dd5-8f18-4960387c6215 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:38.452194 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e48c9-e2dc-4dd5-8f18-4960387c6215 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:38.452405 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 161/308] 10.222.0.15 () {60 vars in 1134 bytes} [Wed Aug 24 04:00:38 2022] POST /identity/v3/groups => generated 229 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:00:38.453095 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f28da-5b00-4397-89eb-d304c64f6732 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:38.457636 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 148/309] 10.222.0.15 () {56 vars in 1308 bytes} [Wed Aug 24 04:00:38 2022] GET /identity/v3/role_assignments?user.id=603b4e9409d34f6c9eff67feb91bccb2&scope.system=all&role.id=63bae148a6d14d6ca8cb30fca2851df5 => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:38.458987 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a013a7-9445-4c05-bb35-b5fe5a18990e None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:38.459313 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a013a7-9445-4c05-bb35-b5fe5a18990e None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:38.459589 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a013a7-9445-4c05-bb35-b5fe5a18990e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:38.501259 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-35a013a7-9445-4c05-bb35-b5fe5a18990e None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:38.503573 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-35a013a7-9445-4c05-bb35-b5fe5a18990e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:38.629599 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 149/310] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:00:38.629879 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:38.697827 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f28da-5b00-4397-89eb-d304c64f6732 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:38.748447 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292d873-1c4b-46f2-b3cc-3f0ba1a7000d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:38.749469 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292d873-1c4b-46f2-b3cc-3f0ba1a7000d None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:38.749918 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292d873-1c4b-46f2-b3cc-3f0ba1a7000d None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:38.750367 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292d873-1c4b-46f2-b3cc-3f0ba1a7000d None admin] PATH_INFO: `/v3/users/6ab2e89614e74e5090684514d1f19cae` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:38.752804 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2292d873-1c4b-46f2-b3cc-3f0ba1a7000d None admin] RBAC: Authorizing `identity:get_user(user_id=6ab2e89614e74e5090684514d1f19cae)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:38.754231 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2292d873-1c4b-46f2-b3cc-3f0ba1a7000d None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:38.756612 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 162/311] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 24 04:00:38 2022] GET /identity/v3/users/6ab2e89614e74e5090684514d1f19cae => generated 293 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:38.763264 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a013a7-9445-4c05-bb35-b5fe5a18990e None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:38.825176 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:38.908863 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a013a7-9445-4c05-bb35-b5fe5a18990e None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:38.949112 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e3f8e2-dd0b-4346-aebb-6f507c952317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:38.949765 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3f8e2-dd0b-4346-aebb-6f507c952317 None admin] REQUEST_METHOD: `PUT` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:38.950045 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3f8e2-dd0b-4346-aebb-6f507c952317 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:38.950319 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3f8e2-dd0b-4346-aebb-6f507c952317 None admin] PATH_INFO: `/v3/system/users/6ab2e89614e74e5090684514d1f19cae/roles/5d03284e31284f60bcc99e4843279067` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:38.951909 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e3f8e2-dd0b-4346-aebb-6f507c952317 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6ab2e89614e74e5090684514d1f19cae, role_id=5d03284e31284f60bcc99e4843279067)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:38.953371 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e3f8e2-dd0b-4346-aebb-6f507c952317 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:38.965164 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 150/312] 10.222.0.15 () {58 vars in 1334 bytes} [Wed Aug 24 04:00:38 2022] PUT /identity/v3/system/users/6ab2e89614e74e5090684514d1f19cae/roles/5d03284e31284f60bcc99e4843279067 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:00:39.010646 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292d873-1c4b-46f2-b3cc-3f0ba1a7000d None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:39.144500 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292d873-1c4b-46f2-b3cc-3f0ba1a7000d None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:39.187033 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65fd5a-702d-4994-abeb-350ccaf183a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:39.188066 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65fd5a-702d-4994-abeb-350ccaf183a3 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:39.188544 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65fd5a-702d-4994-abeb-350ccaf183a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:39.189078 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65fd5a-702d-4994-abeb-350ccaf183a3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:39.193090 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:39.207220 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db65fd5a-702d-4994-abeb-350ccaf183a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:00:39.214261 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-db65fd5a-702d-4994-abeb-350ccaf183a3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:00:39.214261 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:00:39.214261 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:00:39.214261 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:00:39.214261 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:00:39.214261 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:00:39.214261 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:00:39.214261 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:00:39.214261 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:00:39.214261 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:00:39.214261 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:00:39.214261 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:00:39.214261 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:00:39.214261 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:00:39.214261 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:00:39.214261 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:00:39.215860 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:00:39.215860 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:00:39.215860 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:00:39.215860 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:00:39.215860 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:00:39.215860 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:00:39.215860 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:00:39.215860 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:00:39.215860 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:00:39.215860 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:00:39.215860 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:00:39.215860 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:00:39.215860 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:00:39.215860 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:00:39.215860 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:00:39.215860 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:00:39.216935 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:00:39.216935 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:00:39.216935 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:00:39.216935 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:00:39.216935 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:00:39.216935 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:00:39.216935 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:00:39.216935 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:00:39.216935 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:00:39.216935 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:00:39.216935 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:00:39.216935 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:00:39.216935 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 163/313] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 04:00:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:00:39.221952 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e3f8e2-dd0b-4346-aebb-6f507c952317 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:39.365842 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e3f8e2-dd0b-4346-aebb-6f507c952317 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:39.368026 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:39.409139 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395b948-eafe-489e-b24e-1857209b4158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:39.409800 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395b948-eafe-489e-b24e-1857209b4158 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:39.410235 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395b948-eafe-489e-b24e-1857209b4158 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:39.410538 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395b948-eafe-489e-b24e-1857209b4158 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:39.411421 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1395b948-eafe-489e-b24e-1857209b4158 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:39.411759 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1395b948-eafe-489e-b24e-1857209b4158 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:39.413448 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1395b948-eafe-489e-b24e-1857209b4158 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:39.424826 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 151/314] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 24 04:00:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:39.431258 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65fd5a-702d-4994-abeb-350ccaf183a3 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:39.569879 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65fd5a-702d-4994-abeb-350ccaf183a3 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:39.613493 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45099f5-8bce-4874-80ce-cddd2abb86d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:39.614559 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45099f5-8bce-4874-80ce-cddd2abb86d6 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:39.615054 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45099f5-8bce-4874-80ce-cddd2abb86d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:39.615601 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45099f5-8bce-4874-80ce-cddd2abb86d6 None admin] PATH_INFO: `/v3/users/38fbe685e070498897954547d94c867e` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:39.617212 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45099f5-8bce-4874-80ce-cddd2abb86d6 None admin] RBAC: Authorizing `identity:get_user(user_id=38fbe685e070498897954547d94c867e)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:39.619427 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45099f5-8bce-4874-80ce-cddd2abb86d6 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:39.621756 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 164/315] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 24 04:00:39 2022] GET /identity/v3/users/38fbe685e070498897954547d94c867e => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:39.629758 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395b948-eafe-489e-b24e-1857209b4158 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:39.761370 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395b948-eafe-489e-b24e-1857209b4158 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:39.801088 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18812eac-bd0a-43a1-a749-cd26a9c84918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:39.802108 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18812eac-bd0a-43a1-a749-cd26a9c84918 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:39.802583 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18812eac-bd0a-43a1-a749-cd26a9c84918 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:39.803073 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18812eac-bd0a-43a1-a749-cd26a9c84918 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:39.844000 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:39.888009 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18812eac-bd0a-43a1-a749-cd26a9c84918 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:39.889730 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18812eac-bd0a-43a1-a749-cd26a9c84918 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:40.009575 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 152/316] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 24 04:00:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:40.016490 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45099f5-8bce-4874-80ce-cddd2abb86d6 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:40.088937 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:40.133540 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45099f5-8bce-4874-80ce-cddd2abb86d6 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:40.171621 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0026e-db42-438e-87a4-704e0aad4f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:40.172264 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0026e-db42-438e-87a4-704e0aad4f52 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:40.172540 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0026e-db42-438e-87a4-704e0aad4f52 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:40.172810 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0026e-db42-438e-87a4-704e0aad4f52 None admin] PATH_INFO: `/v3/projects/8ecfc9b2a624461bb3d5c27fa0e48b9e` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:40.173985 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a0026e-db42-438e-87a4-704e0aad4f52 None admin] RBAC: Authorizing `identity:get_project(project_id=8ecfc9b2a624461bb3d5c27fa0e48b9e)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:40.175495 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a0026e-db42-438e-87a4-704e0aad4f52 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:40.177555 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 165/317] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 24 04:00:40 2022] GET /identity/v3/projects/8ecfc9b2a624461bb3d5c27fa0e48b9e => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:40.184404 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18812eac-bd0a-43a1-a749-cd26a9c84918 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:40.273000 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:40.323568 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18812eac-bd0a-43a1-a749-cd26a9c84918 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:40.360211 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b1142-8e0f-411c-839e-1de51f1aac30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:40.360816 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b1142-8e0f-411c-839e-1de51f1aac30 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:40.361088 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b1142-8e0f-411c-839e-1de51f1aac30 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:40.361358 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b1142-8e0f-411c-839e-1de51f1aac30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:40.362087 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b1142-8e0f-411c-839e-1de51f1aac30 None admin] RBAC: Adding query filter params (role.id=63bae148a6d14d6ca8cb30fca2851df5, scope.project.id=8ecfc9b2a624461bb3d5c27fa0e48b9e, user.id=38fbe685e070498897954547d94c867e) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:40.362389 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b1142-8e0f-411c-839e-1de51f1aac30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:40.363893 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b1142-8e0f-411c-839e-1de51f1aac30 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:40.370753 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 153/318] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 24 04:00:40 2022] GET /identity/v3/role_assignments?user.id=38fbe685e070498897954547d94c867e&scope.project.id=8ecfc9b2a624461bb3d5c27fa0e48b9e&role.id=63bae148a6d14d6ca8cb30fca2851df5 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:41.058034 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d492f-95f2-474c-be04-73127202414b None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:41.058784 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d492f-95f2-474c-be04-73127202414b None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:41.058784 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d492f-95f2-474c-be04-73127202414b None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:41.060485 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 166/319] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:00:41.066546 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5b7ec-1aa6-4efa-a9ea-4e079c7b593a None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:41.066918 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5b7ec-1aa6-4efa-a9ea-4e079c7b593a None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:41.067429 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5b7ec-1aa6-4efa-a9ea-4e079c7b593a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:41.069967 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5310c-45a0-4a4c-ba14-d37022fc9235 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:41.070256 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5310c-45a0-4a4c-ba14-d37022fc9235 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:41.070580 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5310c-45a0-4a4c-ba14-d37022fc9235 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:41.072162 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 167/320] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:00:41.078158 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092619b-ce8a-480a-95ff-3b69a607b392 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:41.078697 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092619b-ce8a-480a-95ff-3b69a607b392 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:41.079129 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092619b-ce8a-480a-95ff-3b69a607b392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:41.090942 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-efe5b7ec-1aa6-4efa-a9ea-4e079c7b593a None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:41.091979 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-efe5b7ec-1aa6-4efa-a9ea-4e079c7b593a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:41.106303 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-b092619b-ce8a-480a-95ff-3b69a607b392 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:41.107969 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-b092619b-ce8a-480a-95ff-3b69a607b392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:41.170358 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 154/321] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:00:41.189583 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 168/322] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:00:41.391871 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a04f64-759b-4f67-b834-214927604aa2 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:41.392747 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a04f64-759b-4f67-b834-214927604aa2 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:41.393033 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a04f64-759b-4f67-b834-214927604aa2 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:41.394433 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 155/323] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:00:41.400273 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ff1de-8d51-47da-869f-3b7f2033c019 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:41.400522 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ff1de-8d51-47da-869f-3b7f2033c019 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:41.400979 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ff1de-8d51-47da-869f-3b7f2033c019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:41.419888 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-306ff1de-8d51-47da-869f-3b7f2033c019 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:41.421135 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-306ff1de-8d51-47da-869f-3b7f2033c019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:41.482602 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:41.492750 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a04f64-759b-4f67-b834-214927604aa2 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:41.495045 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 169/324] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:00:41.527493 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ff1de-8d51-47da-869f-3b7f2033c019 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:41.560272 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:41.609595 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a04f64-759b-4f67-b834-214927604aa2 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:41.641380 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ff1de-8d51-47da-869f-3b7f2033c019 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:41.646922 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37059e9-6b73-4516-bf9f-50ce3155e3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:41.647589 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37059e9-6b73-4516-bf9f-50ce3155e3a5 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:41.647866 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37059e9-6b73-4516-bf9f-50ce3155e3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:41.648190 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37059e9-6b73-4516-bf9f-50ce3155e3a5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:41.660822 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37059e9-6b73-4516-bf9f-50ce3155e3a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:00:41.666199 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-a37059e9-6b73-4516-bf9f-50ce3155e3a5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:00:41.666199 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:00:41.666199 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:00:41.666199 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:00:41.666199 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:00:41.666199 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:00:41.666199 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:00:41.666199 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:00:41.666199 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:00:41.666199 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:00:41.666199 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:00:41.666199 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:00:41.666199 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:00:41.666199 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:00:41.666199 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:00:41.666199 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:00:41.667092 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:00:41.667092 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:00:41.667092 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:00:41.667092 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:00:41.667092 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:00:41.667092 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:00:41.667092 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:00:41.667092 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:00:41.667092 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:00:41.667092 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:00:41.667092 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:00:41.667092 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:00:41.667092 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:00:41.667092 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:00:41.667092 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:00:41.667092 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:00:41.667933 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:00:41.667933 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:00:41.667933 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:00:41.667933 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:00:41.667933 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:00:41.667933 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:00:41.667933 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:00:41.667933 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:00:41.667933 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:00:41.667933 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:00:41.667933 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:00:41.667933 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:00:41.667933 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 156/325] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 04:00:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:00:41.673670 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37059e9-6b73-4516-bf9f-50ce3155e3a5 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:41.682635 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400ac7a-ff2b-4ebe-a37a-df41d8efa92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:41.683318 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400ac7a-ff2b-4ebe-a37a-df41d8efa92f None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:41.684095 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400ac7a-ff2b-4ebe-a37a-df41d8efa92f None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:41.684095 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400ac7a-ff2b-4ebe-a37a-df41d8efa92f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:41.685023 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400ac7a-ff2b-4ebe-a37a-df41d8efa92f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:41.686528 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400ac7a-ff2b-4ebe-a37a-df41d8efa92f None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:41.688325 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 170/326] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:00:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:00:41.693569 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400ac7a-ff2b-4ebe-a37a-df41d8efa92f None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:41.762000 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:41.787088 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37059e9-6b73-4516-bf9f-50ce3155e3a5 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:41.806523 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:41.810608 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400ac7a-ff2b-4ebe-a37a-df41d8efa92f None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:41.825565 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25bc457-2754-4d0d-b1e2-2cd45d59c54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:41.826227 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25bc457-2754-4d0d-b1e2-2cd45d59c54e None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:41.826466 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25bc457-2754-4d0d-b1e2-2cd45d59c54e None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:41.826739 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25bc457-2754-4d0d-b1e2-2cd45d59c54e None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:41.827455 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25bc457-2754-4d0d-b1e2-2cd45d59c54e None admin] RBAC: Adding query filter params (name=reader) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:41.827763 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25bc457-2754-4d0d-b1e2-2cd45d59c54e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:41.829240 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25bc457-2754-4d0d-b1e2-2cd45d59c54e None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:41.838607 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 157/327] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 24 04:00:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:00:41.840339 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25bc457-2754-4d0d-b1e2-2cd45d59c54e None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:41.849433 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c0e6a-8d5d-415b-84a1-37e39f3ed658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:41.850058 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c0e6a-8d5d-415b-84a1-37e39f3ed658 None admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:41.850337 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c0e6a-8d5d-415b-84a1-37e39f3ed658 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:41.850604 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c0e6a-8d5d-415b-84a1-37e39f3ed658 None admin] PATH_INFO: `/v3/groups` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:41.851284 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c0e6a-8d5d-415b-84a1-37e39f3ed658 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:41.852827 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c0e6a-8d5d-415b-84a1-37e39f3ed658 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:41.874595 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 171/328] 10.222.0.15 () {60 vars in 1134 bytes} [Wed Aug 24 04:00:41 2022] POST /identity/v3/groups => generated 226 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:00:41.875523 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c0e6a-8d5d-415b-84a1-37e39f3ed658 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:41.995137 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25bc457-2754-4d0d-b1e2-2cd45d59c54e None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:42.023542 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c0e6a-8d5d-415b-84a1-37e39f3ed658 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:42.040064 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a0253-c66f-4505-b590-c79ae5dfe173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:42.041034 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a0253-c66f-4505-b590-c79ae5dfe173 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:42.041312 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a0253-c66f-4505-b590-c79ae5dfe173 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:42.041584 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a0253-c66f-4505-b590-c79ae5dfe173 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:42.047535 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:42.056437 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a0253-c66f-4505-b590-c79ae5dfe173 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:00:42.062151 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-c90a0253-c66f-4505-b590-c79ae5dfe173 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:00:42.062151 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:00:42.062151 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:00:42.062151 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:00:42.062151 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:00:42.062151 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:00:42.062151 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:00:42.062151 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:00:42.062151 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:00:42.062151 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:00:42.062151 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:00:42.062151 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:00:42.062151 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:00:42.062151 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:00:42.062151 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:00:42.062151 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:00:42.063308 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:00:42.063308 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:00:42.063308 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:00:42.063308 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:00:42.063308 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:00:42.063308 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:00:42.063308 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:00:42.063308 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:00:42.063308 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:00:42.063308 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:00:42.063308 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:00:42.063308 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:00:42.063308 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:00:42.063308 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:00:42.063308 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:00:42.063308 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:00:42.064213 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:00:42.064213 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:00:42.064213 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:00:42.064213 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:00:42.064213 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:00:42.064213 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:00:42.064213 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:00:42.064213 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:00:42.064213 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:00:42.064213 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:00:42.064213 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:00:42.064213 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:00:42.064213 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 158/329] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 04:00:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:00:42.069702 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a0253-c66f-4505-b590-c79ae5dfe173 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:42.070632 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d8b23-c583-4b60-9b31-f51ef05bf50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:42.071333 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d8b23-c583-4b60-9b31-f51ef05bf50f None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:42.071618 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d8b23-c583-4b60-9b31-f51ef05bf50f None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:42.071889 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d8b23-c583-4b60-9b31-f51ef05bf50f None admin] PATH_INFO: `/v3/users/603b4e9409d34f6c9eff67feb91bccb2` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:42.073448 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876d8b23-c583-4b60-9b31-f51ef05bf50f None admin] RBAC: Authorizing `identity:get_user(user_id=603b4e9409d34f6c9eff67feb91bccb2)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:42.076047 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876d8b23-c583-4b60-9b31-f51ef05bf50f None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:42.077782 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 172/330] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 24 04:00:41 2022] GET /identity/v3/users/603b4e9409d34f6c9eff67feb91bccb2 => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:42.086111 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d8b23-c583-4b60-9b31-f51ef05bf50f None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:42.141335 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:42.227934 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a0253-c66f-4505-b590-c79ae5dfe173 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:42.229601 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d8b23-c583-4b60-9b31-f51ef05bf50f None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:42.270277 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd311d-91a0-49a7-bdde-9985758144f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:42.270816 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd311d-91a0-49a7-bdde-9985758144f1 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:42.271095 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd311d-91a0-49a7-bdde-9985758144f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:42.271424 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd311d-91a0-49a7-bdde-9985758144f1 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:42.272040 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe21b8d-863a-43c4-819c-33df7f9da53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:42.272160 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd311d-91a0-49a7-bdde-9985758144f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:42.272379 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd311d-91a0-49a7-bdde-9985758144f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:42.272705 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe21b8d-863a-43c4-819c-33df7f9da53e None admin] REQUEST_METHOD: `PUT` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:42.272986 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe21b8d-863a-43c4-819c-33df7f9da53e None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:42.273260 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe21b8d-863a-43c4-819c-33df7f9da53e None admin] PATH_INFO: `/v3/system/users/603b4e9409d34f6c9eff67feb91bccb2/roles/63bae148a6d14d6ca8cb30fca2851df5` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:42.273830 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd311d-91a0-49a7-bdde-9985758144f1 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:42.274728 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe21b8d-863a-43c4-819c-33df7f9da53e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=603b4e9409d34f6c9eff67feb91bccb2, role_id=63bae148a6d14d6ca8cb30fca2851df5)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:42.276981 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe21b8d-863a-43c4-819c-33df7f9da53e None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:42.285737 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 159/331] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 24 04:00:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:00:42.289405 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 173/332] 10.222.0.15 () {58 vars in 1334 bytes} [Wed Aug 24 04:00:42 2022] PUT /identity/v3/system/users/603b4e9409d34f6c9eff67feb91bccb2/roles/63bae148a6d14d6ca8cb30fca2851df5 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:00:42.292359 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd311d-91a0-49a7-bdde-9985758144f1 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:42.423887 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd311d-91a0-49a7-bdde-9985758144f1 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:42.425899 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:42.479056 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20900f91-c396-43eb-a92c-0621c97c84fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:42.479839 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20900f91-c396-43eb-a92c-0621c97c84fc None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:42.480253 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20900f91-c396-43eb-a92c-0621c97c84fc None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:42.480533 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20900f91-c396-43eb-a92c-0621c97c84fc None admin] PATH_INFO: `/v3/users/6ab2e89614e74e5090684514d1f19cae` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:42.482826 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20900f91-c396-43eb-a92c-0621c97c84fc None admin] RBAC: Authorizing `identity:get_user(user_id=6ab2e89614e74e5090684514d1f19cae)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:42.484377 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20900f91-c396-43eb-a92c-0621c97c84fc None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:42.486519 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 160/333] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 24 04:00:42 2022] GET /identity/v3/users/6ab2e89614e74e5090684514d1f19cae => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:42.494589 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe21b8d-863a-43c4-819c-33df7f9da53e None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:42.568701 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:42.632782 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe21b8d-863a-43c4-819c-33df7f9da53e None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:42.674351 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d9af4-4c2e-4bda-a85e-73938f6122a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:42.674974 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d9af4-4c2e-4bda-a85e-73938f6122a5 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:42.675333 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d9af4-4c2e-4bda-a85e-73938f6122a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:42.675659 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d9af4-4c2e-4bda-a85e-73938f6122a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:42.676470 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946d9af4-4c2e-4bda-a85e-73938f6122a5 None admin] RBAC: Adding query filter params (role.id=5d03284e31284f60bcc99e4843279067, user.id=6ab2e89614e74e5090684514d1f19cae, scope.system=all) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:42.676780 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946d9af4-4c2e-4bda-a85e-73938f6122a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:42.678295 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946d9af4-4c2e-4bda-a85e-73938f6122a5 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:42.699251 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 174/334] 10.222.0.15 () {56 vars in 1308 bytes} [Wed Aug 24 04:00:42 2022] GET /identity/v3/role_assignments?user.id=6ab2e89614e74e5090684514d1f19cae&scope.system=all&role.id=5d03284e31284f60bcc99e4843279067 => generated 510 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:44.765993 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc176db-52e6-4f5f-b6f6-a12554968b4b None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:44.766765 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc176db-52e6-4f5f-b6f6-a12554968b4b None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:44.766765 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc176db-52e6-4f5f-b6f6-a12554968b4b None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:44.768222 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 161/335] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:00:44.774040 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0bb7d-5ac7-4d4e-82fc-27283f9ec35c None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:44.774983 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0bb7d-5ac7-4d4e-82fc-27283f9ec35c None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:44.775494 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0bb7d-5ac7-4d4e-82fc-27283f9ec35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:44.793129 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937ef2d-b922-456a-bf03-be0f06eb6761 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:44.793774 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937ef2d-b922-456a-bf03-be0f06eb6761 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:44.794264 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937ef2d-b922-456a-bf03-be0f06eb6761 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:44.796438 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 162/336] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:00:44.802221 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9465c5-9797-4629-b7b5-ab155c4c916f None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:44.802878 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9465c5-9797-4629-b7b5-ab155c4c916f None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:44.803553 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9465c5-9797-4629-b7b5-ab155c4c916f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:44.826078 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-33b0bb7d-5ac7-4d4e-82fc-27283f9ec35c None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:44.830276 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-33b0bb7d-5ac7-4d4e-82fc-27283f9ec35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:44.845597 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-9e9465c5-9797-4629-b7b5-ab155c4c916f None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:44.847497 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-9e9465c5-9797-4629-b7b5-ab155c4c916f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:44.993694 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 175/337] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:00:44.996981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 163/338] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:00:45.002179 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10b18f-1db5-4686-97e2-4d0e72b22aa6 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:45.002803 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10b18f-1db5-4686-97e2-4d0e72b22aa6 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:45.003317 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10b18f-1db5-4686-97e2-4d0e72b22aa6 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:45.004898 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 176/339] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:00:45.013235 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faea131-caf4-48af-acda-000da2ba845f None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:45.013804 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faea131-caf4-48af-acda-000da2ba845f None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:45.014237 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faea131-caf4-48af-acda-000da2ba845f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:45.038977 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-8faea131-caf4-48af-acda-000da2ba845f None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:45.040662 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-8faea131-caf4-48af-acda-000da2ba845f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:45.145067 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 164/340] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:00:45.705574 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10b18f-1db5-4686-97e2-4d0e72b22aa6 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:45.743531 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faea131-caf4-48af-acda-000da2ba845f None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:45.778901 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:45.802477 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:45.938254 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faea131-caf4-48af-acda-000da2ba845f None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:45.972070 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10b18f-1db5-4686-97e2-4d0e72b22aa6 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:45.991502 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675486b6-e926-4c83-bf90-0b9d6bdf78f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:45.992230 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675486b6-e926-4c83-bf90-0b9d6bdf78f8 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:45.992507 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675486b6-e926-4c83-bf90-0b9d6bdf78f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:45.992776 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675486b6-e926-4c83-bf90-0b9d6bdf78f8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:46.020097 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675486b6-e926-4c83-bf90-0b9d6bdf78f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:00:46.026212 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-675486b6-e926-4c83-bf90-0b9d6bdf78f8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:00:46.026212 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:00:46.026212 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:00:46.026212 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:00:46.026212 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:00:46.026212 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:00:46.026212 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:00:46.026212 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:00:46.026212 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:00:46.026212 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:00:46.026212 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:00:46.026212 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:00:46.026212 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:00:46.026212 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:00:46.026212 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:00:46.026212 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:00:46.027120 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:00:46.027120 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:00:46.027120 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:00:46.027120 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:00:46.027120 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:00:46.027120 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:00:46.027120 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:00:46.027120 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:00:46.027120 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:00:46.027120 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:00:46.027120 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:00:46.027120 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:00:46.027120 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:00:46.027120 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:00:46.027120 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:00:46.027120 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:00:46.027944 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:00:46.027944 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:00:46.027944 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:00:46.027944 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:00:46.027944 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:00:46.027944 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:00:46.027944 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:00:46.027944 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:00:46.027944 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:00:46.027944 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:00:46.027944 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:00:46.027944 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:00:46.030583 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 165/341] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Aug 24 04:00:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:00:46.032650 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675486b6-e926-4c83-bf90-0b9d6bdf78f8 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:46.054536 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c4515-48bc-464c-be00-196b9f2c4c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:46.055605 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c4515-48bc-464c-be00-196b9f2c4c0c None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:46.056125 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c4515-48bc-464c-be00-196b9f2c4c0c None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:46.056612 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c4515-48bc-464c-be00-196b9f2c4c0c None admin] PATH_INFO: `/v3/roles/member` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:46.078897 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597c4515-48bc-464c-be00-196b9f2c4c0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:00:46.088585 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-597c4515-48bc-464c-be00-196b9f2c4c0c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:00:46.088585 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:00:46.088585 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:00:46.088585 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:00:46.088585 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:00:46.088585 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:00:46.088585 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:00:46.088585 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:00:46.088585 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:00:46.088585 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:00:46.088585 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:00:46.088585 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:00:46.088585 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:00:46.088585 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:00:46.088585 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:00:46.088585 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:00:46.089538 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:00:46.089538 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:00:46.089538 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:00:46.089538 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:00:46.089538 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:00:46.089538 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:00:46.089538 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:00:46.089538 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:00:46.089538 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:00:46.089538 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:00:46.089538 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:00:46.089538 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:00:46.089538 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:00:46.089538 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:00:46.089538 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:00:46.089538 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:00:46.090320 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:00:46.090320 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:00:46.090320 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:00:46.090320 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:00:46.090320 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:00:46.090320 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:00:46.090320 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:00:46.090320 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:00:46.090320 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:00:46.090320 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:00:46.090320 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:00:46.090320 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:00:46.096598 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 177/342] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 04:00:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:00:46.097598 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c4515-48bc-464c-be00-196b9f2c4c0c None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:46.223600 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:46.245420 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675486b6-e926-4c83-bf90-0b9d6bdf78f8 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:46.300104 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:46.314068 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c4515-48bc-464c-be00-196b9f2c4c0c None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:46.316562 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803fd08b-5bd9-4fb6-8b2d-dc1e01a0cfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:46.317347 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fd08b-5bd9-4fb6-8b2d-dc1e01a0cfc6 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:46.317712 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fd08b-5bd9-4fb6-8b2d-dc1e01a0cfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:46.318206 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fd08b-5bd9-4fb6-8b2d-dc1e01a0cfc6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:46.356308 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803fd08b-5bd9-4fb6-8b2d-dc1e01a0cfc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:00:46.361637 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-803fd08b-5bd9-4fb6-8b2d-dc1e01a0cfc6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:00:46.361637 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:00:46.361637 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:00:46.361637 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:00:46.361637 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:00:46.361637 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:00:46.361637 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:00:46.361637 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:00:46.361637 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:00:46.361637 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:00:46.361637 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:00:46.361637 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:00:46.361637 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:00:46.361637 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:00:46.361637 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:00:46.361637 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:00:46.362593 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:00:46.362593 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:00:46.362593 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:00:46.362593 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:00:46.362593 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:00:46.362593 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:00:46.362593 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:00:46.362593 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:00:46.362593 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:00:46.362593 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:00:46.362593 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:00:46.362593 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:00:46.362593 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:00:46.362593 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:00:46.362593 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:00:46.362593 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:00:46.363426 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:00:46.363426 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:00:46.363426 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:00:46.363426 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:00:46.363426 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:00:46.363426 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:00:46.363426 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:00:46.363426 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:00:46.363426 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:00:46.363426 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:00:46.363426 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:00:46.363426 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:00:46.365188 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 166/343] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 04:00:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:00:46.366308 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803fd08b-5bd9-4fb6-8b2d-dc1e01a0cfc6 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:46.372606 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf52336-3af3-49a3-8a67-1d525434a7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:46.373350 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf52336-3af3-49a3-8a67-1d525434a7ad None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:46.373822 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf52336-3af3-49a3-8a67-1d525434a7ad None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:46.374293 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf52336-3af3-49a3-8a67-1d525434a7ad None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:46.375379 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf52336-3af3-49a3-8a67-1d525434a7ad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:46.375888 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf52336-3af3-49a3-8a67-1d525434a7ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:46.377505 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf52336-3af3-49a3-8a67-1d525434a7ad None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:46.388613 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 178/344] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 24 04:00:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:46.390246 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f1f3d-fd93-4ef2-b4de-19d4ef46ab4b None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:46.390842 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f1f3d-fd93-4ef2-b4de-19d4ef46ab4b None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:46.391334 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f1f3d-fd93-4ef2-b4de-19d4ef46ab4b None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:46.392878 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 179/345] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:00:46.396262 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f1f3d-fd93-4ef2-b4de-19d4ef46ab4b None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:46.531447 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803fd08b-5bd9-4fb6-8b2d-dc1e01a0cfc6 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:46.535460 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f1f3d-fd93-4ef2-b4de-19d4ef46ab4b None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:46.583623 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64151209-ec68-4e10-8984-215bc1e9245f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:46.584567 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64151209-ec68-4e10-8984-215bc1e9245f None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:46.585036 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64151209-ec68-4e10-8984-215bc1e9245f None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:46.585500 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64151209-ec68-4e10-8984-215bc1e9245f None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:46.586404 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64151209-ec68-4e10-8984-215bc1e9245f None admin] RBAC: Adding query filter params (name=reader) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:46.586891 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64151209-ec68-4e10-8984-215bc1e9245f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:46.588551 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64151209-ec68-4e10-8984-215bc1e9245f None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:46.590889 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3cbc75-98f2-435b-a2f5-c222a9d5c846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:46.594737 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3cbc75-98f2-435b-a2f5-c222a9d5c846 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:46.595081 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3cbc75-98f2-435b-a2f5-c222a9d5c846 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:46.595594 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3cbc75-98f2-435b-a2f5-c222a9d5c846 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:46.605690 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 180/346] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 24 04:00:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:46.606234 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3cbc75-98f2-435b-a2f5-c222a9d5c846 None admin] RBAC: Adding query filter params (name=member) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:46.606731 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3cbc75-98f2-435b-a2f5-c222a9d5c846 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:46.606910 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64151209-ec68-4e10-8984-215bc1e9245f None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:46.608970 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3cbc75-98f2-435b-a2f5-c222a9d5c846 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:46.625432 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 167/347] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 24 04:00:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:46.627335 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dba225-6244-4eaa-ae20-94296cf4282d None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:46.627904 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dba225-6244-4eaa-ae20-94296cf4282d None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:46.628407 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dba225-6244-4eaa-ae20-94296cf4282d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:46.644047 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:46.651695 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-e4dba225-6244-4eaa-ae20-94296cf4282d None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:46.654276 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-e4dba225-6244-4eaa-ae20-94296cf4282d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:46.672886 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:46.742623 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64151209-ec68-4e10-8984-215bc1e9245f None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:46.755380 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 168/348] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:00:46.757965 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dba225-6244-4eaa-ae20-94296cf4282d None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:46.784975 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4983f-ca1a-4396-b500-3bad8bb3b5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:46.785500 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4983f-ca1a-4396-b500-3bad8bb3b5c2 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:46.785779 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4983f-ca1a-4396-b500-3bad8bb3b5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:46.786048 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4983f-ca1a-4396-b500-3bad8bb3b5c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:46.885767 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4983f-ca1a-4396-b500-3bad8bb3b5c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:46.888339 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4983f-ca1a-4396-b500-3bad8bb3b5c2 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:46.901742 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dba225-6244-4eaa-ae20-94296cf4282d None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:46.921165 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:46.947223 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce03ecf-d493-43aa-8421-0b74df647294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:46.948354 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce03ecf-d493-43aa-8421-0b74df647294 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:46.948831 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce03ecf-d493-43aa-8421-0b74df647294 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:46.949376 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce03ecf-d493-43aa-8421-0b74df647294 None admin] PATH_INFO: `/v3/users/603b4e9409d34f6c9eff67feb91bccb2` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:46.950758 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce03ecf-d493-43aa-8421-0b74df647294 None admin] RBAC: Authorizing `identity:get_user(user_id=603b4e9409d34f6c9eff67feb91bccb2)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:46.952532 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce03ecf-d493-43aa-8421-0b74df647294 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:46.954464 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 169/349] 10.222.0.15 () {56 vars in 1177 bytes} [Wed Aug 24 04:00:46 2022] GET /identity/v3/users/603b4e9409d34f6c9eff67feb91bccb2 => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:46.955442 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce03ecf-d493-43aa-8421-0b74df647294 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:46.968796 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:47.012863 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 181/350] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 24 04:00:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:47.014218 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8182ff-33e3-4ba5-9753-58636e9de0c6 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:47.014504 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8182ff-33e3-4ba5-9753-58636e9de0c6 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:47.014779 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8182ff-33e3-4ba5-9753-58636e9de0c6 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:47.016601 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 182/351] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:00:47.017872 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8182ff-33e3-4ba5-9753-58636e9de0c6 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:47.082534 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce03ecf-d493-43aa-8421-0b74df647294 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:47.122094 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec53cb-8f77-4b0e-8d60-776849e82929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:47.123091 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec53cb-8f77-4b0e-8d60-776849e82929 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:47.123649 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec53cb-8f77-4b0e-8d60-776849e82929 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:47.124109 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec53cb-8f77-4b0e-8d60-776849e82929 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:47.132877 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8182ff-33e3-4ba5-9753-58636e9de0c6 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:47.159899 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:47.174760 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeee39f-ed39-42a7-804a-cebe8bd472e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:47.175464 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeee39f-ed39-42a7-804a-cebe8bd472e8 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:47.175929 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeee39f-ed39-42a7-804a-cebe8bd472e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:47.176204 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeee39f-ed39-42a7-804a-cebe8bd472e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:47.177424 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeee39f-ed39-42a7-804a-cebe8bd472e8 None admin] RBAC: Adding query filter params (role.id=63bae148a6d14d6ca8cb30fca2851df5, user.id=603b4e9409d34f6c9eff67feb91bccb2, scope.system=all) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:47.177752 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeee39f-ed39-42a7-804a-cebe8bd472e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:47.179600 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeee39f-ed39-42a7-804a-cebe8bd472e8 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:47.194044 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 183/352] 10.222.0.15 () {56 vars in 1308 bytes} [Wed Aug 24 04:00:47 2022] GET /identity/v3/role_assignments?user.id=603b4e9409d34f6c9eff67feb91bccb2&scope.system=all&role.id=63bae148a6d14d6ca8cb30fca2851df5 => generated 510 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:47.196441 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeee39f-ed39-42a7-804a-cebe8bd472e8 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:47.203985 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ec53cb-8f77-4b0e-8d60-776849e82929 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:47.205868 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ec53cb-8f77-4b0e-8d60-776849e82929 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:47.222830 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:47.337386 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeee39f-ed39-42a7-804a-cebe8bd472e8 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:47.355309 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 170/353] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 24 04:00:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:47.356086 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544905f-daa8-4835-a6f8-0a0935b333d1 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:47.356367 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544905f-daa8-4835-a6f8-0a0935b333d1 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:47.356637 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544905f-daa8-4835-a6f8-0a0935b333d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:47.381451 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-4544905f-daa8-4835-a6f8-0a0935b333d1 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:47.383032 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-4544905f-daa8-4835-a6f8-0a0935b333d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:47.390505 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10a950-05a2-46ca-bfaa-aef0406f111c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:47.391133 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10a950-05a2-46ca-bfaa-aef0406f111c None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:47.391450 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10a950-05a2-46ca-bfaa-aef0406f111c None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:47.391719 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10a950-05a2-46ca-bfaa-aef0406f111c None admin] PATH_INFO: `/v3/projects/b8831e7463bf44df920eb14d1ccf1502` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:47.393441 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10a950-05a2-46ca-bfaa-aef0406f111c None admin] RBAC: Authorizing `identity:get_project(project_id=b8831e7463bf44df920eb14d1ccf1502)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:47.397026 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10a950-05a2-46ca-bfaa-aef0406f111c None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:47.400904 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 184/354] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 24 04:00:47 2022] GET /identity/v3/projects/b8831e7463bf44df920eb14d1ccf1502 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:47.401760 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10a950-05a2-46ca-bfaa-aef0406f111c None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:47.472218 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:47.479325 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 171/355] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:00:47.480685 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d971b-8a12-4b1f-8147-a88acc7af168 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:47.480888 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d971b-8a12-4b1f-8147-a88acc7af168 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:47.481157 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d971b-8a12-4b1f-8147-a88acc7af168 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:47.482524 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 172/356] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:00:47.483076 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d971b-8a12-4b1f-8147-a88acc7af168 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:47.533595 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10a950-05a2-46ca-bfaa-aef0406f111c None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:47.543787 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:47.583185 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1940a-002f-472b-8221-ed22fa3cca2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:47.584107 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1940a-002f-472b-8221-ed22fa3cca2d None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:47.584550 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1940a-002f-472b-8221-ed22fa3cca2d None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:47.585348 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1940a-002f-472b-8221-ed22fa3cca2d None admin] PATH_INFO: `/v3/roles/member` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:47.599279 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a1940a-002f-472b-8221-ed22fa3cca2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:00:47.606773 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-e9a1940a-002f-472b-8221-ed22fa3cca2d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:00:47.606773 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:00:47.606773 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:00:47.606773 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:00:47.606773 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:00:47.606773 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:00:47.606773 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:00:47.606773 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:00:47.606773 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:00:47.606773 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:00:47.606773 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:00:47.606773 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:00:47.606773 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:00:47.606773 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:00:47.606773 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:00:47.606773 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:00:47.607752 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:00:47.607752 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:00:47.607752 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:00:47.607752 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:00:47.607752 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:00:47.607752 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:00:47.607752 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:00:47.607752 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:00:47.607752 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:00:47.607752 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:00:47.607752 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:00:47.607752 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:00:47.607752 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:00:47.607752 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:00:47.607752 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:00:47.607752 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:00:47.608544 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:00:47.608544 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:00:47.608544 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:00:47.608544 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:00:47.608544 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:00:47.608544 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:00:47.608544 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:00:47.608544 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:00:47.608544 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:00:47.608544 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:00:47.608544 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:00:47.608544 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:00:47.611069 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 185/357] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 04:00:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:00:47.612287 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1940a-002f-472b-8221-ed22fa3cca2d None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:47.613242 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d971b-8a12-4b1f-8147-a88acc7af168 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:47.653382 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a175c0a-08b1-440e-a16a-90fe60cd386c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:47.654951 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a175c0a-08b1-440e-a16a-90fe60cd386c None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:47.655241 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a175c0a-08b1-440e-a16a-90fe60cd386c None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:47.655513 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a175c0a-08b1-440e-a16a-90fe60cd386c None admin] PATH_INFO: `/v3/projects/b8831e7463bf44df920eb14d1ccf1502` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:47.656678 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a175c0a-08b1-440e-a16a-90fe60cd386c None admin] RBAC: Authorizing `identity:get_project(project_id=b8831e7463bf44df920eb14d1ccf1502)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:47.658834 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a175c0a-08b1-440e-a16a-90fe60cd386c None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:47.662924 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 173/358] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 24 04:00:47 2022] GET /identity/v3/projects/b8831e7463bf44df920eb14d1ccf1502 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:47.664864 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86c71c-ab5d-49ad-acf7-c9e8a4b7daf3 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:47.665265 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86c71c-ab5d-49ad-acf7-c9e8a4b7daf3 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:47.665550 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86c71c-ab5d-49ad-acf7-c9e8a4b7daf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:47.689777 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-0f86c71c-ab5d-49ad-acf7-c9e8a4b7daf3 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:47.690976 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-0f86c71c-ab5d-49ad-acf7-c9e8a4b7daf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:47.740212 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1940a-002f-472b-8221-ed22fa3cca2d None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:47.755361 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:47.775471 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 174/359] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:00:47.776348 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f86c71c-ab5d-49ad-acf7-c9e8a4b7daf3 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:47.795659 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb92502-d701-480f-897e-b4a499819443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:47.797142 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb92502-d701-480f-897e-b4a499819443 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:47.797560 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb92502-d701-480f-897e-b4a499819443 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:47.798276 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb92502-d701-480f-897e-b4a499819443 None admin] PATH_INFO: `/v3/groups/985366e454d242448e3f2b84883169ef` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:47.809205 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb92502-d701-480f-897e-b4a499819443 None admin] RBAC: Authorizing `identity:get_group(group_id=985366e454d242448e3f2b84883169ef)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:47.811709 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb92502-d701-480f-897e-b4a499819443 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:47.813846 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 186/360] 10.222.0.15 () {56 vars in 1180 bytes} [Wed Aug 24 04:00:47 2022] GET /identity/v3/groups/985366e454d242448e3f2b84883169ef => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:47.815675 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb92502-d701-480f-897e-b4a499819443 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:47.828473 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:47.924834 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f86c71c-ab5d-49ad-acf7-c9e8a4b7daf3 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:47.962414 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb92502-d701-480f-897e-b4a499819443 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:47.975751 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f5278-e945-4984-94f3-78a6b1990f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:47.976936 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f5278-e945-4984-94f3-78a6b1990f68 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:47.977420 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f5278-e945-4984-94f3-78a6b1990f68 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:47.978049 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f5278-e945-4984-94f3-78a6b1990f68 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:47.979433 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f5278-e945-4984-94f3-78a6b1990f68 None admin] RBAC: Adding query filter params (name=member) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:47.980190 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f5278-e945-4984-94f3-78a6b1990f68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:47.981961 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f5278-e945-4984-94f3-78a6b1990f68 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:47.993273 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 175/361] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 24 04:00:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:47.994742 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f5278-e945-4984-94f3-78a6b1990f68 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:48.002909 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5946d8-e731-4851-a1a5-1c41e8c20d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:48.003584 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5946d8-e731-4851-a1a5-1c41e8c20d74 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:48.003866 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5946d8-e731-4851-a1a5-1c41e8c20d74 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:48.004138 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5946d8-e731-4851-a1a5-1c41e8c20d74 None admin] PATH_INFO: `/v3/groups/985366e454d242448e3f2b84883169ef` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:48.005278 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5946d8-e731-4851-a1a5-1c41e8c20d74 None admin] RBAC: Authorizing `identity:get_group(group_id=985366e454d242448e3f2b84883169ef)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:48.007622 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5946d8-e731-4851-a1a5-1c41e8c20d74 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:48.010302 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 187/362] 10.222.0.15 () {56 vars in 1180 bytes} [Wed Aug 24 04:00:47 2022] GET /identity/v3/groups/985366e454d242448e3f2b84883169ef => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:48.011089 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5946d8-e731-4851-a1a5-1c41e8c20d74 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:48.061874 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:48.134775 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:48.134977 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5946d8-e731-4851-a1a5-1c41e8c20d74 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:48.137867 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f5278-e945-4984-94f3-78a6b1990f68 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:48.177108 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf54ba-afbb-4e04-972d-191fab67d6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:48.177639 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf54ba-afbb-4e04-972d-191fab67d6cf None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:48.177921 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf54ba-afbb-4e04-972d-191fab67d6cf None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:48.178193 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf54ba-afbb-4e04-972d-191fab67d6cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:48.178951 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf54ba-afbb-4e04-972d-191fab67d6cf None admin] RBAC: Adding query filter params (group.id=985366e454d242448e3f2b84883169ef, role.id=a9f3803644ca4a6fab51b9513141be7b, scope.project.id=b8831e7463bf44df920eb14d1ccf1502) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:48.179253 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf54ba-afbb-4e04-972d-191fab67d6cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:48.180136 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be8994-590c-4de2-a45d-4966d0b70aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:48.180760 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf54ba-afbb-4e04-972d-191fab67d6cf None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:48.181135 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be8994-590c-4de2-a45d-4966d0b70aea None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:48.181572 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be8994-590c-4de2-a45d-4966d0b70aea None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:48.181998 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be8994-590c-4de2-a45d-4966d0b70aea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:48.188399 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 176/363] 10.222.0.15 () {56 vars in 1376 bytes} [Wed Aug 24 04:00:47 2022] GET /identity/v3/role_assignments?group.id=985366e454d242448e3f2b84883169ef&scope.project.id=b8831e7463bf44df920eb14d1ccf1502&role.id=a9f3803644ca4a6fab51b9513141be7b => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:48.188773 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf54ba-afbb-4e04-972d-191fab67d6cf None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:48.198822 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be8994-590c-4de2-a45d-4966d0b70aea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:00:48.204499 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-75be8994-590c-4de2-a45d-4966d0b70aea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:00:48.204499 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:00:48.204499 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:00:48.204499 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:00:48.204499 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:00:48.204499 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:00:48.204499 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:00:48.204499 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:00:48.204499 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:00:48.204499 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:00:48.204499 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:00:48.204499 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:00:48.204499 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:00:48.204499 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:00:48.204499 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:00:48.204499 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:00:48.205462 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:00:48.205462 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:00:48.205462 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:00:48.205462 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:00:48.205462 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:00:48.205462 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:00:48.205462 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:00:48.205462 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:00:48.205462 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:00:48.205462 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:00:48.205462 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:00:48.205462 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:00:48.205462 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:00:48.205462 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:00:48.205462 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:00:48.205462 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:00:48.206259 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:00:48.206259 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:00:48.206259 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:00:48.206259 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:00:48.206259 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:00:48.206259 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:00:48.206259 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:00:48.206259 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:00:48.206259 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:00:48.206259 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:00:48.206259 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:00:48.206259 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:00:48.206259 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 188/364] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Aug 24 04:00:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:00:48.206937 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be8994-590c-4de2-a45d-4966d0b70aea None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:48.328719 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf54ba-afbb-4e04-972d-191fab67d6cf None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:48.345253 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be8994-590c-4de2-a45d-4966d0b70aea None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:48.347268 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:48.373195 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e18872-c48d-4284-82b7-8c82fc5e29c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:48.373828 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e18872-c48d-4284-82b7-8c82fc5e29c6 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:48.374106 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e18872-c48d-4284-82b7-8c82fc5e29c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:48.374382 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e18872-c48d-4284-82b7-8c82fc5e29c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:48.403626 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02731664-9177-4206-acc9-8a7ba6ce937a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:48.404238 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02731664-9177-4206-acc9-8a7ba6ce937a None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:48.404511 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02731664-9177-4206-acc9-8a7ba6ce937a None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:48.404772 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02731664-9177-4206-acc9-8a7ba6ce937a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:48.405501 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02731664-9177-4206-acc9-8a7ba6ce937a None admin] RBAC: Adding query filter params (group.id=985366e454d242448e3f2b84883169ef, role.id=5d03284e31284f60bcc99e4843279067, scope.project.id=b8831e7463bf44df920eb14d1ccf1502) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:48.405803 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02731664-9177-4206-acc9-8a7ba6ce937a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:48.407285 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02731664-9177-4206-acc9-8a7ba6ce937a None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:48.415353 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 189/365] 10.222.0.15 () {56 vars in 1376 bytes} [Wed Aug 24 04:00:48 2022] GET /identity/v3/role_assignments?group.id=985366e454d242448e3f2b84883169ef&scope.project.id=b8831e7463bf44df920eb14d1ccf1502&role.id=5d03284e31284f60bcc99e4843279067 => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:48.417546 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02731664-9177-4206-acc9-8a7ba6ce937a None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:48.423655 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:48.473856 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e18872-c48d-4284-82b7-8c82fc5e29c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:48.475463 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e18872-c48d-4284-82b7-8c82fc5e29c6 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:48.568594 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02731664-9177-4206-acc9-8a7ba6ce937a None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:48.611893 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 177/366] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 24 04:00:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:48.612774 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e18872-c48d-4284-82b7-8c82fc5e29c6 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:48.624950 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49798bbc-40d8-4181-b644-ae4431182798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:48.625602 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49798bbc-40d8-4181-b644-ae4431182798 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:48.625876 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49798bbc-40d8-4181-b644-ae4431182798 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:48.626141 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49798bbc-40d8-4181-b644-ae4431182798 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:48.642788 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49798bbc-40d8-4181-b644-ae4431182798 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:00:48.651015 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-49798bbc-40d8-4181-b644-ae4431182798 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:00:48.651015 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:00:48.651015 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:00:48.651015 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:00:48.651015 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:00:48.651015 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:00:48.651015 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:00:48.651015 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:00:48.651015 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:00:48.651015 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:00:48.651015 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:00:48.651015 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:00:48.651015 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:00:48.651015 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:00:48.651015 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:00:48.651015 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:00:48.651984 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:00:48.651984 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:00:48.651984 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:00:48.651984 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:00:48.651984 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:00:48.651984 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:00:48.651984 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:00:48.651984 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:00:48.651984 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:00:48.651984 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:00:48.651984 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:00:48.651984 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:00:48.651984 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:00:48.651984 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:00:48.651984 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:00:48.651984 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:00:48.652768 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:00:48.652768 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:00:48.652768 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:00:48.652768 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:00:48.652768 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:00:48.652768 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:00:48.652768 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:00:48.652768 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:00:48.652768 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:00:48.652768 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:00:48.652768 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:00:48.652768 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:00:48.653380 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 190/367] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 24 04:00:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:00:48.658817 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49798bbc-40d8-4181-b644-ae4431182798 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:48.697595 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:48.711872 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:48.764413 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e18872-c48d-4284-82b7-8c82fc5e29c6 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:48.802861 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49798bbc-40d8-4181-b644-ae4431182798 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:48.807680 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b69a9-c012-457a-b211-1f5e86127126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:48.808548 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b69a9-c012-457a-b211-1f5e86127126 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:48.809040 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b69a9-c012-457a-b211-1f5e86127126 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:48.809514 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b69a9-c012-457a-b211-1f5e86127126 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:48.810396 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b69a9-c012-457a-b211-1f5e86127126 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:48.810906 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b69a9-c012-457a-b211-1f5e86127126 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:48.812550 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b69a9-c012-457a-b211-1f5e86127126 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:48.822805 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 178/368] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 24 04:00:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:48.824133 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b69a9-c012-457a-b211-1f5e86127126 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:48.847172 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402848c2-8677-4922-9bca-070a96bd3556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:48.847962 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402848c2-8677-4922-9bca-070a96bd3556 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:48.848247 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402848c2-8677-4922-9bca-070a96bd3556 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:48.848575 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402848c2-8677-4922-9bca-070a96bd3556 None admin] PATH_INFO: `/v3/projects/8ecfc9b2a624461bb3d5c27fa0e48b9e` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:48.849748 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402848c2-8677-4922-9bca-070a96bd3556 None admin] RBAC: Authorizing `identity:get_project(project_id=8ecfc9b2a624461bb3d5c27fa0e48b9e)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:48.852513 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402848c2-8677-4922-9bca-070a96bd3556 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:48.855989 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 191/369] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 24 04:00:48 2022] GET /identity/v3/projects/8ecfc9b2a624461bb3d5c27fa0e48b9e => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:48.857716 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402848c2-8677-4922-9bca-070a96bd3556 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:48.989151 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b69a9-c012-457a-b211-1f5e86127126 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:48.998109 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:49.010171 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402848c2-8677-4922-9bca-070a96bd3556 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:49.035695 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:49.048333 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005f450-3b7c-4695-9a1a-400f9474c988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:49.049512 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005f450-3b7c-4695-9a1a-400f9474c988 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:49.050041 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005f450-3b7c-4695-9a1a-400f9474c988 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:49.050568 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005f450-3b7c-4695-9a1a-400f9474c988 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:49.051507 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0005f450-3b7c-4695-9a1a-400f9474c988 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:49.052031 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0005f450-3b7c-4695-9a1a-400f9474c988 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:49.054591 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0005f450-3b7c-4695-9a1a-400f9474c988 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:49.058891 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127972f-a71c-4e0f-987f-dc4849b12a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:49.059593 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127972f-a71c-4e0f-987f-dc4849b12a0f None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:49.059872 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127972f-a71c-4e0f-987f-dc4849b12a0f None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:49.060139 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127972f-a71c-4e0f-987f-dc4849b12a0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:49.069052 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 179/370] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 04:00:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:49.070858 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005f450-3b7c-4695-9a1a-400f9474c988 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:49.167339 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9127972f-a71c-4e0f-987f-dc4849b12a0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:49.169189 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9127972f-a71c-4e0f-987f-dc4849b12a0f None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:49.214648 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005f450-3b7c-4695-9a1a-400f9474c988 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:49.258380 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a56d45-3f78-4d8a-a72a-44a5a50fccb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:49.259107 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a56d45-3f78-4d8a-a72a-44a5a50fccb5 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:49.259328 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a56d45-3f78-4d8a-a72a-44a5a50fccb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:49.259605 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a56d45-3f78-4d8a-a72a-44a5a50fccb5 None admin] PATH_INFO: `/v3/groups/985366e454d242448e3f2b84883169ef` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:49.260750 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a56d45-3f78-4d8a-a72a-44a5a50fccb5 None admin] RBAC: Authorizing `identity:get_group(group_id=985366e454d242448e3f2b84883169ef)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:49.262206 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a56d45-3f78-4d8a-a72a-44a5a50fccb5 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:49.264158 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 180/371] 10.222.0.15 () {56 vars in 1180 bytes} [Wed Aug 24 04:00:49 2022] GET /identity/v3/groups/985366e454d242448e3f2b84883169ef => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:49.265002 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a56d45-3f78-4d8a-a72a-44a5a50fccb5 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:49.313375 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:49.313375 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 192/372] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 24 04:00:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:49.317487 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127972f-a71c-4e0f-987f-dc4849b12a0f None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:49.340382 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:49.396093 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a56d45-3f78-4d8a-a72a-44a5a50fccb5 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:49.443521 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57057b0-9296-4f55-b2e7-a9f34c3dfafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:49.444547 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57057b0-9296-4f55-b2e7-a9f34c3dfafe None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:49.444866 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57057b0-9296-4f55-b2e7-a9f34c3dfafe None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:49.445304 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57057b0-9296-4f55-b2e7-a9f34c3dfafe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:49.448613 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127972f-a71c-4e0f-987f-dc4849b12a0f None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:49.501604 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a84463-8cd4-43da-b7b4-867aaa58811a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:49.502228 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a84463-8cd4-43da-b7b4-867aaa58811a None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:49.502770 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a84463-8cd4-43da-b7b4-867aaa58811a None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:49.503038 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a84463-8cd4-43da-b7b4-867aaa58811a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:49.504352 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a84463-8cd4-43da-b7b4-867aaa58811a None admin] RBAC: Adding query filter params (group.id=985366e454d242448e3f2b84883169ef, role.id=5d03284e31284f60bcc99e4843279067, scope.project.id=8ecfc9b2a624461bb3d5c27fa0e48b9e) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:49.504660 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a84463-8cd4-43da-b7b4-867aaa58811a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:49.508578 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a84463-8cd4-43da-b7b4-867aaa58811a None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:49.517418 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 193/373] 10.222.0.15 () {56 vars in 1376 bytes} [Wed Aug 24 04:00:49 2022] GET /identity/v3/role_assignments?group.id=985366e454d242448e3f2b84883169ef&scope.project.id=8ecfc9b2a624461bb3d5c27fa0e48b9e&role.id=5d03284e31284f60bcc99e4843279067 => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:49.520149 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a84463-8cd4-43da-b7b4-867aaa58811a None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:49.544472 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57057b0-9296-4f55-b2e7-a9f34c3dfafe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:49.546868 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57057b0-9296-4f55-b2e7-a9f34c3dfafe None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:49.616506 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:49.676365 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:49.681584 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a84463-8cd4-43da-b7b4-867aaa58811a None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:49.731506 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3dccdc-caac-434d-b245-1e84ad2299eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:49.732256 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3dccdc-caac-434d-b245-1e84ad2299eb None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:49.732538 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3dccdc-caac-434d-b245-1e84ad2299eb None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:49.732903 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3dccdc-caac-434d-b245-1e84ad2299eb None admin] PATH_INFO: `/v3/projects/8ecfc9b2a624461bb3d5c27fa0e48b9e` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:49.734164 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3dccdc-caac-434d-b245-1e84ad2299eb None admin] RBAC: Authorizing `identity:get_project(project_id=8ecfc9b2a624461bb3d5c27fa0e48b9e)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:49.738751 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3dccdc-caac-434d-b245-1e84ad2299eb None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:49.740181 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 181/374] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 24 04:00:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:49.740719 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 194/375] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 24 04:00:49 2022] GET /identity/v3/projects/8ecfc9b2a624461bb3d5c27fa0e48b9e => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:49.746061 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57057b0-9296-4f55-b2e7-a9f34c3dfafe None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:49.750016 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3dccdc-caac-434d-b245-1e84ad2299eb None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:49.855812 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57057b0-9296-4f55-b2e7-a9f34c3dfafe None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:49.872412 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3dccdc-caac-434d-b245-1e84ad2299eb None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:49.896514 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b6441-403f-4ac5-a0a1-61004cbfd94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:49.898845 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b6441-403f-4ac5-a0a1-61004cbfd94f None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:49.898845 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b6441-403f-4ac5-a0a1-61004cbfd94f None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:49.898845 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b6441-403f-4ac5-a0a1-61004cbfd94f None admin] PATH_INFO: `/v3/projects/3d781cc0590648468fbe68aed993b0f3` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:49.900321 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b6441-403f-4ac5-a0a1-61004cbfd94f None admin] RBAC: Authorizing `identity:get_project(project_id=3d781cc0590648468fbe68aed993b0f3)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:49.901797 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b6441-403f-4ac5-a0a1-61004cbfd94f None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:49.903818 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 182/376] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 24 04:00:49 2022] GET /identity/v3/projects/3d781cc0590648468fbe68aed993b0f3 => generated 344 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:49.911419 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b6441-403f-4ac5-a0a1-61004cbfd94f None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:49.912456 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:49.942019 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112802c-6916-4a0a-ad18-83c301dec5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:49.942711 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112802c-6916-4a0a-ad18-83c301dec5b6 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:49.943035 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112802c-6916-4a0a-ad18-83c301dec5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:49.943330 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112802c-6916-4a0a-ad18-83c301dec5b6 None admin] PATH_INFO: `/v3/groups/985366e454d242448e3f2b84883169ef` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:49.945141 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e112802c-6916-4a0a-ad18-83c301dec5b6 None admin] RBAC: Authorizing `identity:get_group(group_id=985366e454d242448e3f2b84883169ef)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:49.946632 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e112802c-6916-4a0a-ad18-83c301dec5b6 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:49.950375 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 195/377] 10.222.0.15 () {56 vars in 1180 bytes} [Wed Aug 24 04:00:49 2022] GET /identity/v3/groups/985366e454d242448e3f2b84883169ef => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:49.956293 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:49.957552 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112802c-6916-4a0a-ad18-83c301dec5b6 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:50.102797 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112802c-6916-4a0a-ad18-83c301dec5b6 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:50.141794 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b6441-403f-4ac5-a0a1-61004cbfd94f None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:50.164260 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23390ecb-ab5d-4844-b955-f976e7e6ea58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:50.164945 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23390ecb-ab5d-4844-b955-f976e7e6ea58 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:50.165231 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23390ecb-ab5d-4844-b955-f976e7e6ea58 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:50.165500 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23390ecb-ab5d-4844-b955-f976e7e6ea58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:50.166235 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23390ecb-ab5d-4844-b955-f976e7e6ea58 None admin] RBAC: Adding query filter params (group.id=985366e454d242448e3f2b84883169ef, role.id=a9f3803644ca4a6fab51b9513141be7b, scope.project.id=8ecfc9b2a624461bb3d5c27fa0e48b9e) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:50.166538 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23390ecb-ab5d-4844-b955-f976e7e6ea58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:50.168007 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23390ecb-ab5d-4844-b955-f976e7e6ea58 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:50.178607 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 196/378] 10.222.0.15 () {56 vars in 1376 bytes} [Wed Aug 24 04:00:49 2022] GET /identity/v3/role_assignments?group.id=985366e454d242448e3f2b84883169ef&scope.project.id=8ecfc9b2a624461bb3d5c27fa0e48b9e&role.id=a9f3803644ca4a6fab51b9513141be7b => generated 260 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:50.205053 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4cd49-dc0e-4a74-9811-20c5b137feed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:50.205696 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4cd49-dc0e-4a74-9811-20c5b137feed None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:50.205967 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4cd49-dc0e-4a74-9811-20c5b137feed None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:50.206231 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4cd49-dc0e-4a74-9811-20c5b137feed None admin] PATH_INFO: `/v3/groups/8cd12e8f879c4d1287bd7ed4fcee92e1` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:50.215261 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4cd49-dc0e-4a74-9811-20c5b137feed None admin] RBAC: Authorizing `identity:get_group(group_id=8cd12e8f879c4d1287bd7ed4fcee92e1)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:50.215747 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4cd49-dc0e-4a74-9811-20c5b137feed None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:50.217618 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 183/379] 10.222.0.15 () {56 vars in 1180 bytes} [Wed Aug 24 04:00:49 2022] GET /identity/v3/groups/8cd12e8f879c4d1287bd7ed4fcee92e1 => generated 229 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:50.223589 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23390ecb-ab5d-4844-b955-f976e7e6ea58 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:50.304629 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:50.353320 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23390ecb-ab5d-4844-b955-f976e7e6ea58 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:50.394627 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf517e8a-b9d1-4400-9581-510f0efab4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:50.395364 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf517e8a-b9d1-4400-9581-510f0efab4b3 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:50.395644 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf517e8a-b9d1-4400-9581-510f0efab4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:50.395914 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf517e8a-b9d1-4400-9581-510f0efab4b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:50.396651 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf517e8a-b9d1-4400-9581-510f0efab4b3 None admin] RBAC: Adding query filter params (group.id=8cd12e8f879c4d1287bd7ed4fcee92e1, role.id=df6a8bb215d54f71a0b6988a9c01f5e4, scope.project.id=3d781cc0590648468fbe68aed993b0f3) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:50.396961 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf517e8a-b9d1-4400-9581-510f0efab4b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:50.398495 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf517e8a-b9d1-4400-9581-510f0efab4b3 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:50.405399 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 197/380] 10.222.0.15 () {56 vars in 1376 bytes} [Wed Aug 24 04:00:50 2022] GET /identity/v3/role_assignments?group.id=8cd12e8f879c4d1287bd7ed4fcee92e1&scope.project.id=3d781cc0590648468fbe68aed993b0f3&role.id=df6a8bb215d54f71a0b6988a9c01f5e4 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:51.183908 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e8a57-51fa-4aca-8da1-b457f1ff43bf None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:51.184409 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e8a57-51fa-4aca-8da1-b457f1ff43bf None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:51.184409 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e8a57-51fa-4aca-8da1-b457f1ff43bf None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:51.185971 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 184/381] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:00:51.191329 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea955d-c2ea-4904-8cd2-cf3355afef45 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:51.191770 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea955d-c2ea-4904-8cd2-cf3355afef45 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:51.191865 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea955d-c2ea-4904-8cd2-cf3355afef45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:51.215959 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-4eea955d-c2ea-4904-8cd2-cf3355afef45 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:51.217478 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-4eea955d-c2ea-4904-8cd2-cf3355afef45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:51.260786 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1bebb-d97f-4e82-8f95-d1bb639f1e08 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:51.261111 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1bebb-d97f-4e82-8f95-d1bb639f1e08 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:51.261389 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1bebb-d97f-4e82-8f95-d1bb639f1e08 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:51.262845 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 185/382] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:00:51.272717 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78cdef1-d4a9-401d-be09-40d3dec8c07c None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:51.273135 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78cdef1-d4a9-401d-be09-40d3dec8c07c None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:51.273254 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78cdef1-d4a9-401d-be09-40d3dec8c07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:51.300820 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-f78cdef1-d4a9-401d-be09-40d3dec8c07c None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:51.301738 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 198/383] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:00:51.302045 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-f78cdef1-d4a9-401d-be09-40d3dec8c07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:51.373311 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 186/384] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:00:51.708903 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea955d-c2ea-4904-8cd2-cf3355afef45 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:51.778415 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:51.840127 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea955d-c2ea-4904-8cd2-cf3355afef45 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:51.884337 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731803c-5a43-4cbb-aa92-ed6f987efbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:51.885718 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78cdef1-d4a9-401d-be09-40d3dec8c07c None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:51.897235 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731803c-5a43-4cbb-aa92-ed6f987efbff None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:51.899328 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731803c-5a43-4cbb-aa92-ed6f987efbff None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:51.899607 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731803c-5a43-4cbb-aa92-ed6f987efbff None admin] PATH_INFO: `/v3/roles/member` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:51.914321 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:51.925122 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b731803c-5a43-4cbb-aa92-ed6f987efbff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:00:51.930102 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-b731803c-5a43-4cbb-aa92-ed6f987efbff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:00:51.930102 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:00:51.930102 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:00:51.930102 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:00:51.930102 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:00:51.930102 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:00:51.930102 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:00:51.930102 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:00:51.930102 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:00:51.930102 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:00:51.930102 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:00:51.930102 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:00:51.930102 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:00:51.930102 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:00:51.930102 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:00:51.930102 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:00:51.931059 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:00:51.931059 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:00:51.931059 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:00:51.931059 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:00:51.931059 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:00:51.931059 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:00:51.931059 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:00:51.931059 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:00:51.931059 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:00:51.931059 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:00:51.931059 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:00:51.931059 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:00:51.931059 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:00:51.931059 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:00:51.931059 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:00:51.931059 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:00:51.931913 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:00:51.931913 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:00:51.931913 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:00:51.931913 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:00:51.931913 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:00:51.931913 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:00:51.931913 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:00:51.931913 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:00:51.931913 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:00:51.931913 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:00:51.931913 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:00:51.931913 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:00:51.931913 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 199/385] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 04:00:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:00:51.945707 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731803c-5a43-4cbb-aa92-ed6f987efbff None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:52.079556 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78cdef1-d4a9-401d-be09-40d3dec8c07c None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:52.085396 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731803c-5a43-4cbb-aa92-ed6f987efbff None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:52.115616 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:52.121526 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90942bf-763b-46ac-b030-fa41577e8e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:52.122183 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90942bf-763b-46ac-b030-fa41577e8e45 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:52.122460 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90942bf-763b-46ac-b030-fa41577e8e45 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:52.122780 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90942bf-763b-46ac-b030-fa41577e8e45 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:52.136091 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90942bf-763b-46ac-b030-fa41577e8e45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:00:52.141371 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-e90942bf-763b-46ac-b030-fa41577e8e45 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:00:52.141371 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:00:52.141371 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:00:52.141371 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:00:52.141371 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:00:52.141371 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:00:52.141371 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:00:52.141371 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:00:52.141371 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:00:52.141371 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:00:52.141371 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:00:52.141371 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:00:52.141371 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:00:52.141371 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:00:52.141371 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:00:52.141371 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:00:52.142323 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:00:52.142323 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:00:52.142323 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:00:52.142323 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:00:52.142323 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:00:52.142323 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:00:52.142323 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:00:52.142323 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:00:52.142323 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:00:52.142323 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:00:52.142323 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:00:52.142323 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:00:52.142323 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:00:52.142323 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:00:52.142323 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:00:52.142323 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:00:52.143096 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:00:52.143096 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:00:52.143096 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:00:52.143096 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:00:52.143096 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:00:52.143096 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:00:52.143096 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:00:52.143096 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:00:52.143096 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:00:52.143096 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:00:52.143096 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:00:52.143096 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:00:52.143096 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 187/386] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Aug 24 04:00:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:00:52.150546 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90942bf-763b-46ac-b030-fa41577e8e45 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:52.156886 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc98297-8f39-4b03-b12d-fea0af73eae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:52.157843 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc98297-8f39-4b03-b12d-fea0af73eae1 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:52.158341 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc98297-8f39-4b03-b12d-fea0af73eae1 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:52.158831 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc98297-8f39-4b03-b12d-fea0af73eae1 None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:52.159737 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc98297-8f39-4b03-b12d-fea0af73eae1 None admin] RBAC: Adding query filter params (name=member) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:52.160238 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc98297-8f39-4b03-b12d-fea0af73eae1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:52.161821 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc98297-8f39-4b03-b12d-fea0af73eae1 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:52.183281 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 200/387] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 24 04:00:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:00:52.188846 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc98297-8f39-4b03-b12d-fea0af73eae1 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:52.248343 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:52.273560 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90942bf-763b-46ac-b030-fa41577e8e45 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:52.320247 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67889dd9-8411-4101-8e92-1c3d2e30c661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:52.321149 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67889dd9-8411-4101-8e92-1c3d2e30c661 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:52.321598 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67889dd9-8411-4101-8e92-1c3d2e30c661 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:52.321996 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67889dd9-8411-4101-8e92-1c3d2e30c661 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:52.322936 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67889dd9-8411-4101-8e92-1c3d2e30c661 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:52.323957 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67889dd9-8411-4101-8e92-1c3d2e30c661 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:52.326090 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67889dd9-8411-4101-8e92-1c3d2e30c661 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:52.345401 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 188/388] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 24 04:00:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:00:52.351827 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67889dd9-8411-4101-8e92-1c3d2e30c661 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:52.412138 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc98297-8f39-4b03-b12d-fea0af73eae1 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:52.458230 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e372cc2-9e63-4e22-bd01-7d747b146702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:52.459037 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e372cc2-9e63-4e22-bd01-7d747b146702 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:52.459561 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e372cc2-9e63-4e22-bd01-7d747b146702 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:52.459817 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e372cc2-9e63-4e22-bd01-7d747b146702 None admin] PATH_INFO: `/v3/groups/985366e454d242448e3f2b84883169ef` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:52.461215 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e372cc2-9e63-4e22-bd01-7d747b146702 None admin] RBAC: Authorizing `identity:get_group(group_id=985366e454d242448e3f2b84883169ef)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:52.462803 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e372cc2-9e63-4e22-bd01-7d747b146702 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:52.464858 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 201/389] 10.222.0.15 () {56 vars in 1180 bytes} [Wed Aug 24 04:00:52 2022] GET /identity/v3/groups/985366e454d242448e3f2b84883169ef => generated 226 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:00:52.466220 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b0888-0b4e-4caa-94f3-d62c3978fd98 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:52.466605 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b0888-0b4e-4caa-94f3-d62c3978fd98 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:52.467000 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b0888-0b4e-4caa-94f3-d62c3978fd98 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:52.468692 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 202/390] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:00:52.473746 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b0888-0b4e-4caa-94f3-d62c3978fd98 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:52.473974 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67889dd9-8411-4101-8e92-1c3d2e30c661 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:52.512313 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e20ec2-b2cd-4360-87c8-9aabbaff340e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:52.513198 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e20ec2-b2cd-4360-87c8-9aabbaff340e None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:52.513647 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e20ec2-b2cd-4360-87c8-9aabbaff340e None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:52.514053 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e20ec2-b2cd-4360-87c8-9aabbaff340e None admin] PATH_INFO: `/v3/groups/985366e454d242448e3f2b84883169ef` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:52.515536 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e20ec2-b2cd-4360-87c8-9aabbaff340e None admin] RBAC: Authorizing `identity:get_group(group_id=985366e454d242448e3f2b84883169ef)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:52.517183 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e20ec2-b2cd-4360-87c8-9aabbaff340e None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:52.519304 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 189/391] 10.222.0.15 () {56 vars in 1180 bytes} [Wed Aug 24 04:00:52 2022] GET /identity/v3/groups/985366e454d242448e3f2b84883169ef => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:52.520765 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc30eae-a67a-41ca-ac66-a426c2149625 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:52.521167 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc30eae-a67a-41ca-ac66-a426c2149625 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:52.521580 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc30eae-a67a-41ca-ac66-a426c2149625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:52.527465 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:52.542100 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-cdc30eae-a67a-41ca-ac66-a426c2149625 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:52.543348 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-cdc30eae-a67a-41ca-ac66-a426c2149625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:52.545627 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:52.608505 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b0888-0b4e-4caa-94f3-d62c3978fd98 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:52.624855 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 190/392] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:00:52.632127 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc30eae-a67a-41ca-ac66-a426c2149625 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:52.665005 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a043c-ed8a-41e8-925b-c67935ec8915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:52.666084 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a043c-ed8a-41e8-925b-c67935ec8915 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:52.666550 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a043c-ed8a-41e8-925b-c67935ec8915 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:52.667024 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a043c-ed8a-41e8-925b-c67935ec8915 None admin] PATH_INFO: `/v3/projects/b8831e7463bf44df920eb14d1ccf1502` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:52.668384 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26a043c-ed8a-41e8-925b-c67935ec8915 None admin] RBAC: Authorizing `identity:get_project(project_id=b8831e7463bf44df920eb14d1ccf1502)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:52.670065 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26a043c-ed8a-41e8-925b-c67935ec8915 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:52.672624 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 203/393] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 24 04:00:52 2022] GET /identity/v3/projects/b8831e7463bf44df920eb14d1ccf1502 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:52.679800 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a043c-ed8a-41e8-925b-c67935ec8915 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:52.822016 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc30eae-a67a-41ca-ac66-a426c2149625 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:52.873331 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a043c-ed8a-41e8-925b-c67935ec8915 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:52.886677 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:52.914276 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd627b1-be08-4098-a60b-b99704774a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:52.914928 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd627b1-be08-4098-a60b-b99704774a8b None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:52.915218 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd627b1-be08-4098-a60b-b99704774a8b None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:52.915504 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd627b1-be08-4098-a60b-b99704774a8b None admin] PATH_INFO: `/v3/projects/b8831e7463bf44df920eb14d1ccf1502` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:52.917057 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd627b1-be08-4098-a60b-b99704774a8b None admin] RBAC: Authorizing `identity:get_project(project_id=b8831e7463bf44df920eb14d1ccf1502)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:52.919843 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd627b1-be08-4098-a60b-b99704774a8b None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:52.921152 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d431a2-a181-4539-8780-9cef770f710c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:52.921820 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d431a2-a181-4539-8780-9cef770f710c None admin] REQUEST_METHOD: `PUT` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:52.922091 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d431a2-a181-4539-8780-9cef770f710c None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:52.922354 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d431a2-a181-4539-8780-9cef770f710c None admin] PATH_INFO: `/v3/projects/b8831e7463bf44df920eb14d1ccf1502/groups/985366e454d242448e3f2b84883169ef/roles/5d03284e31284f60bcc99e4843279067` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:52.924974 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d431a2-a181-4539-8780-9cef770f710c None admin] RBAC: Authorizing `identity:create_grant(project_id=b8831e7463bf44df920eb14d1ccf1502, group_id=985366e454d242448e3f2b84883169ef, role_id=5d03284e31284f60bcc99e4843279067)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:52.926429 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d431a2-a181-4539-8780-9cef770f710c None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:52.929115 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 191/394] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 24 04:00:52 2022] GET /identity/v3/projects/b8831e7463bf44df920eb14d1ccf1502 => generated 298 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:52.935802 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd627b1-be08-4098-a60b-b99704774a8b None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:52.949237 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:52.961141 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 204/395] 10.222.0.15 () {58 vars in 1442 bytes} [Wed Aug 24 04:00:52 2022] PUT /identity/v3/projects/b8831e7463bf44df920eb14d1ccf1502/groups/985366e454d242448e3f2b84883169ef/roles/5d03284e31284f60bcc99e4843279067 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:00:53.005201 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d431a2-a181-4539-8780-9cef770f710c None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:53.091242 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd627b1-be08-4098-a60b-b99704774a8b None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:53.131981 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d431a2-a181-4539-8780-9cef770f710c None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:53.141391 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40ff87-deec-495e-9fa0-341770524f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:53.141943 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40ff87-deec-495e-9fa0-341770524f86 None admin] REQUEST_METHOD: `PUT` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:53.142562 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40ff87-deec-495e-9fa0-341770524f86 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:53.142850 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40ff87-deec-495e-9fa0-341770524f86 None admin] PATH_INFO: `/v3/projects/b8831e7463bf44df920eb14d1ccf1502/groups/985366e454d242448e3f2b84883169ef/roles/a9f3803644ca4a6fab51b9513141be7b` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:53.145279 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df40ff87-deec-495e-9fa0-341770524f86 None admin] RBAC: Authorizing `identity:create_grant(project_id=b8831e7463bf44df920eb14d1ccf1502, group_id=985366e454d242448e3f2b84883169ef, role_id=a9f3803644ca4a6fab51b9513141be7b)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:53.146763 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df40ff87-deec-495e-9fa0-341770524f86 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:53.162281 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 192/396] 10.222.0.15 () {58 vars in 1442 bytes} [Wed Aug 24 04:00:52 2022] PUT /identity/v3/projects/b8831e7463bf44df920eb14d1ccf1502/groups/985366e454d242448e3f2b84883169ef/roles/a9f3803644ca4a6fab51b9513141be7b => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:00:53.163730 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48648f-b844-4113-9e7b-0609dec9c0b4 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:53.164017 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48648f-b844-4113-9e7b-0609dec9c0b4 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:53.164291 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48648f-b844-4113-9e7b-0609dec9c0b4 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:53.167036 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 193/397] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:00:53.168406 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b991e5-3682-45df-a6da-0ea379ecbab5 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:53.168694 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b991e5-3682-45df-a6da-0ea379ecbab5 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:53.168968 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b991e5-3682-45df-a6da-0ea379ecbab5 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:53.170580 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 194/398] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:00:53.176322 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91b194-986e-4798-8824-6b8eff109c90 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:53.176609 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91b194-986e-4798-8824-6b8eff109c90 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:53.176894 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91b194-986e-4798-8824-6b8eff109c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:53.179966 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7248d49-75fc-485a-be80-bf0eccfffacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:53.180634 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7248d49-75fc-485a-be80-bf0eccfffacb None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:53.180919 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7248d49-75fc-485a-be80-bf0eccfffacb None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:53.181188 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7248d49-75fc-485a-be80-bf0eccfffacb None admin] PATH_INFO: `/v3/roles/member` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:53.193732 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7248d49-75fc-485a-be80-bf0eccfffacb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:00:53.199065 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-ab91b194-986e-4798-8824-6b8eff109c90 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:53.200335 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-e7248d49-75fc-485a-be80-bf0eccfffacb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:00:53.200335 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:00:53.200335 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:00:53.200335 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:00:53.200335 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:00:53.200335 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:00:53.200335 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:00:53.200335 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:00:53.200335 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:00:53.200335 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:00:53.200335 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:00:53.200335 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:00:53.200335 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:00:53.200335 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:00:53.200335 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:00:53.200335 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:00:53.201233 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:00:53.201233 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:00:53.201233 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:00:53.201233 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:00:53.201233 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:00:53.201233 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:00:53.201233 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:00:53.201233 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:00:53.201233 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:00:53.201233 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:00:53.201233 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:00:53.201233 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:00:53.201233 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:00:53.201233 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:00:53.201233 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:00:53.201233 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:00:53.202007 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:00:53.202007 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:00:53.202007 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:00:53.202007 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:00:53.202007 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:00:53.202007 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:00:53.202007 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:00:53.202007 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:00:53.202007 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:00:53.202007 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:00:53.202007 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:00:53.202007 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:00:53.202007 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 205/399] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 04:00:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:00:53.203122 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01321374-b268-47f2-9612-c691817663fa None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:53.203122 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01321374-b268-47f2-9612-c691817663fa None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:53.203396 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01321374-b268-47f2-9612-c691817663fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:53.203752 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-ab91b194-986e-4798-8824-6b8eff109c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:53.226986 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-01321374-b268-47f2-9612-c691817663fa None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:53.228273 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-01321374-b268-47f2-9612-c691817663fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:53.265085 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:53.295629 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:53.300461 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 195/400] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:00:53.302065 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91b194-986e-4798-8824-6b8eff109c90 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:53.350744 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 206/401] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:00:53.447186 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91b194-986e-4798-8824-6b8eff109c90 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:53.493373 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e4127c-34c3-484a-ae0b-14a54b98fe82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:53.494315 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4127c-34c3-484a-ae0b-14a54b98fe82 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:53.494770 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4127c-34c3-484a-ae0b-14a54b98fe82 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:53.495239 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4127c-34c3-484a-ae0b-14a54b98fe82 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:53.496115 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e4127c-34c3-484a-ae0b-14a54b98fe82 None admin] RBAC: Adding query filter params (name=member) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:53.496588 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e4127c-34c3-484a-ae0b-14a54b98fe82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:53.498161 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e4127c-34c3-484a-ae0b-14a54b98fe82 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:53.508325 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 196/402] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 24 04:00:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:53.513590 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01321374-b268-47f2-9612-c691817663fa None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:53.658935 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01321374-b268-47f2-9612-c691817663fa None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:53.670793 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e4127c-34c3-484a-ae0b-14a54b98fe82 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:53.699026 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125a444-c03a-495f-a2b7-4ea07bc3c8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:53.699237 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125a444-c03a-495f-a2b7-4ea07bc3c8ae None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:53.700371 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125a444-c03a-495f-a2b7-4ea07bc3c8ae None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:53.700655 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125a444-c03a-495f-a2b7-4ea07bc3c8ae None admin] PATH_INFO: `/v3/groups/985366e454d242448e3f2b84883169ef` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:53.703449 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125a444-c03a-495f-a2b7-4ea07bc3c8ae None admin] RBAC: Authorizing `identity:get_group(group_id=985366e454d242448e3f2b84883169ef)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:53.704925 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125a444-c03a-495f-a2b7-4ea07bc3c8ae None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:53.711923 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 207/403] 10.222.0.15 () {56 vars in 1180 bytes} [Wed Aug 24 04:00:53 2022] GET /identity/v3/groups/985366e454d242448e3f2b84883169ef => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:53.715634 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125a444-c03a-495f-a2b7-4ea07bc3c8ae None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:53.773064 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:53.778727 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:53.845739 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e4127c-34c3-484a-ae0b-14a54b98fe82 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:53.887246 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125a444-c03a-495f-a2b7-4ea07bc3c8ae None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:53.887588 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f8514-e3c4-4188-aef7-b633ceb7283a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:53.888231 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f8514-e3c4-4188-aef7-b633ceb7283a None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:53.888514 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f8514-e3c4-4188-aef7-b633ceb7283a None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:53.888785 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f8514-e3c4-4188-aef7-b633ceb7283a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:53.906085 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f8514-e3c4-4188-aef7-b633ceb7283a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:00:53.911670 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-371f8514-e3c4-4188-aef7-b633ceb7283a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:00:53.911670 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:00:53.911670 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:00:53.911670 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:00:53.911670 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:00:53.911670 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:00:53.911670 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:00:53.911670 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:00:53.911670 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:00:53.911670 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:00:53.911670 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:00:53.911670 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:00:53.911670 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:00:53.911670 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:00:53.911670 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:00:53.911670 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:00:53.912573 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:00:53.912573 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:00:53.912573 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:00:53.912573 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:00:53.912573 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:00:53.912573 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:00:53.912573 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:00:53.912573 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:00:53.912573 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:00:53.912573 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:00:53.912573 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:00:53.912573 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:00:53.912573 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:00:53.912573 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:00:53.912573 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:00:53.912573 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:00:53.913367 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:00:53.913367 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:00:53.913367 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:00:53.913367 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:00:53.913367 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:00:53.913367 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:00:53.913367 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:00:53.913367 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:00:53.913367 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:00:53.913367 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:00:53.913367 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:00:53.913367 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:00:53.913367 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 197/404] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 24 04:00:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:00:53.914059 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f8514-e3c4-4188-aef7-b633ceb7283a None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:53.940947 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d3159-910c-4204-bfdf-656a91e6dcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:53.941598 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d3159-910c-4204-bfdf-656a91e6dcb1 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:53.941878 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d3159-910c-4204-bfdf-656a91e6dcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:53.942151 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d3159-910c-4204-bfdf-656a91e6dcb1 None admin] PATH_INFO: `/v3/projects/8ecfc9b2a624461bb3d5c27fa0e48b9e` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:53.947272 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d3159-910c-4204-bfdf-656a91e6dcb1 None admin] RBAC: Authorizing `identity:get_project(project_id=8ecfc9b2a624461bb3d5c27fa0e48b9e)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:53.950067 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d3159-910c-4204-bfdf-656a91e6dcb1 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:53.953314 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 208/405] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 24 04:00:53 2022] GET /identity/v3/projects/8ecfc9b2a624461bb3d5c27fa0e48b9e => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:53.955097 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d3159-910c-4204-bfdf-656a91e6dcb1 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:54.033114 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f8514-e3c4-4188-aef7-b633ceb7283a None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:54.052452 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:54.072289 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f400da6-3128-4252-8eeb-f8e4143a05e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:54.072993 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f400da6-3128-4252-8eeb-f8e4143a05e0 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:54.073203 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f400da6-3128-4252-8eeb-f8e4143a05e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:54.073475 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f400da6-3128-4252-8eeb-f8e4143a05e0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:54.086602 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f400da6-3128-4252-8eeb-f8e4143a05e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:00:54.088428 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:54.092193 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-6f400da6-3128-4252-8eeb-f8e4143a05e0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:00:54.092193 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:00:54.092193 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:00:54.092193 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:00:54.092193 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:00:54.092193 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:00:54.092193 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:00:54.092193 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:00:54.092193 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:00:54.092193 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:00:54.092193 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:00:54.092193 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:00:54.092193 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:00:54.092193 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:00:54.092193 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:00:54.092193 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:00:54.093081 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:00:54.093081 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:00:54.093081 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:00:54.093081 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:00:54.093081 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:00:54.093081 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:00:54.093081 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:00:54.093081 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:00:54.093081 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:00:54.093081 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:00:54.093081 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:00:54.093081 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:00:54.093081 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:00:54.093081 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:00:54.093081 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:00:54.093081 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:00:54.093862 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:00:54.093862 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:00:54.093862 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:00:54.093862 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:00:54.093862 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:00:54.093862 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:00:54.093862 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:00:54.093862 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:00:54.093862 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:00:54.093862 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:00:54.093862 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:00:54.093862 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:00:54.098233 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 198/406] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Aug 24 04:00:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:00:54.099091 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f400da6-3128-4252-8eeb-f8e4143a05e0 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:54.100106 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d3159-910c-4204-bfdf-656a91e6dcb1 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:54.138914 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc6e0f-a4d3-4fd6-bad3-5dffae6c4d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:54.139560 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc6e0f-a4d3-4fd6-bad3-5dffae6c4d73 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:54.139841 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc6e0f-a4d3-4fd6-bad3-5dffae6c4d73 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:54.140115 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc6e0f-a4d3-4fd6-bad3-5dffae6c4d73 None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:54.140877 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abc6e0f-a4d3-4fd6-bad3-5dffae6c4d73 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:54.141184 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abc6e0f-a4d3-4fd6-bad3-5dffae6c4d73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:54.142561 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abc6e0f-a4d3-4fd6-bad3-5dffae6c4d73 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:54.152014 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 209/407] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 04:00:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:54.153017 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc6e0f-a4d3-4fd6-bad3-5dffae6c4d73 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:54.231860 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f400da6-3128-4252-8eeb-f8e4143a05e0 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:54.274546 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852cb6a1-db9c-42bc-9320-a6d33d2908d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:54.275242 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852cb6a1-db9c-42bc-9320-a6d33d2908d2 None admin] REQUEST_METHOD: `PUT` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:54.275572 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852cb6a1-db9c-42bc-9320-a6d33d2908d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:54.275854 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852cb6a1-db9c-42bc-9320-a6d33d2908d2 None admin] PATH_INFO: `/v3/projects/8ecfc9b2a624461bb3d5c27fa0e48b9e/groups/985366e454d242448e3f2b84883169ef/roles/5d03284e31284f60bcc99e4843279067` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:54.277833 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852cb6a1-db9c-42bc-9320-a6d33d2908d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=8ecfc9b2a624461bb3d5c27fa0e48b9e, group_id=985366e454d242448e3f2b84883169ef, role_id=5d03284e31284f60bcc99e4843279067)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:54.278977 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc6e0f-a4d3-4fd6-bad3-5dffae6c4d73 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:54.279329 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852cb6a1-db9c-42bc-9320-a6d33d2908d2 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:54.296146 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 199/408] 10.222.0.15 () {58 vars in 1442 bytes} [Wed Aug 24 04:00:54 2022] PUT /identity/v3/projects/8ecfc9b2a624461bb3d5c27fa0e48b9e/groups/985366e454d242448e3f2b84883169ef/roles/5d03284e31284f60bcc99e4843279067 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:00:54.297157 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852cb6a1-db9c-42bc-9320-a6d33d2908d2 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:54.323804 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8badbf-e9d2-4b36-9060-3ab06447f9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:54.324804 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8badbf-e9d2-4b36-9060-3ab06447f9a3 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:54.325290 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8badbf-e9d2-4b36-9060-3ab06447f9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:54.325787 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8badbf-e9d2-4b36-9060-3ab06447f9a3 None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:54.327084 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8badbf-e9d2-4b36-9060-3ab06447f9a3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:54.327641 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8badbf-e9d2-4b36-9060-3ab06447f9a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:54.329368 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8badbf-e9d2-4b36-9060-3ab06447f9a3 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:54.340636 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 210/409] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 24 04:00:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:54.345880 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:54.348098 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8badbf-e9d2-4b36-9060-3ab06447f9a3 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:54.378724 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:54.415259 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852cb6a1-db9c-42bc-9320-a6d33d2908d2 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:54.453876 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cebe3f-d79f-4771-9f68-0c7c240ca1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:54.454529 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cebe3f-d79f-4771-9f68-0c7c240ca1f3 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:54.454809 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cebe3f-d79f-4771-9f68-0c7c240ca1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:54.455078 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cebe3f-d79f-4771-9f68-0c7c240ca1f3 None admin] PATH_INFO: `/v3/groups/8cd12e8f879c4d1287bd7ed4fcee92e1` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:54.456530 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cebe3f-d79f-4771-9f68-0c7c240ca1f3 None admin] RBAC: Authorizing `identity:get_group(group_id=8cd12e8f879c4d1287bd7ed4fcee92e1)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:54.458194 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cebe3f-d79f-4771-9f68-0c7c240ca1f3 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:54.459975 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 200/410] 10.222.0.15 () {56 vars in 1180 bytes} [Wed Aug 24 04:00:54 2022] GET /identity/v3/groups/8cd12e8f879c4d1287bd7ed4fcee92e1 => generated 229 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:54.466081 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cebe3f-d79f-4771-9f68-0c7c240ca1f3 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:54.476646 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8badbf-e9d2-4b36-9060-3ab06447f9a3 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:54.516712 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c75495-7fc3-458e-8781-cf531b67fd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:54.518265 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c75495-7fc3-458e-8781-cf531b67fd17 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:54.518750 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c75495-7fc3-458e-8781-cf531b67fd17 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:54.519328 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c75495-7fc3-458e-8781-cf531b67fd17 None admin] PATH_INFO: `/v3/groups/985366e454d242448e3f2b84883169ef` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:54.520854 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c75495-7fc3-458e-8781-cf531b67fd17 None admin] RBAC: Authorizing `identity:get_group(group_id=985366e454d242448e3f2b84883169ef)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:54.522677 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c75495-7fc3-458e-8781-cf531b67fd17 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:54.525159 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 211/411] 10.222.0.15 () {56 vars in 1180 bytes} [Wed Aug 24 04:00:54 2022] GET /identity/v3/groups/985366e454d242448e3f2b84883169ef => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:54.531227 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c75495-7fc3-458e-8781-cf531b67fd17 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:54.587428 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cebe3f-d79f-4771-9f68-0c7c240ca1f3 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:54.611651 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:54.626290 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c7a4d-ff1e-43c4-9127-325b59adc739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:54.626948 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c7a4d-ff1e-43c4-9127-325b59adc739 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:54.627257 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c7a4d-ff1e-43c4-9127-325b59adc739 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:54.627542 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c7a4d-ff1e-43c4-9127-325b59adc739 None admin] PATH_INFO: `/v3/projects/3d781cc0590648468fbe68aed993b0f3` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:54.628718 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c7a4d-ff1e-43c4-9127-325b59adc739 None admin] RBAC: Authorizing `identity:get_project(project_id=3d781cc0590648468fbe68aed993b0f3)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:54.630497 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c7a4d-ff1e-43c4-9127-325b59adc739 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:54.636528 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 201/412] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 24 04:00:54 2022] GET /identity/v3/projects/3d781cc0590648468fbe68aed993b0f3 => generated 344 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:54.639652 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c7a4d-ff1e-43c4-9127-325b59adc739 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:54.640631 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:54.653835 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c75495-7fc3-458e-8781-cf531b67fd17 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:54.690602 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9616eda-0132-4e63-b298-882fe42b6051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:54.691272 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9616eda-0132-4e63-b298-882fe42b6051 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:54.691540 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9616eda-0132-4e63-b298-882fe42b6051 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:54.691815 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9616eda-0132-4e63-b298-882fe42b6051 None admin] PATH_INFO: `/v3/projects/8ecfc9b2a624461bb3d5c27fa0e48b9e` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:54.693104 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9616eda-0132-4e63-b298-882fe42b6051 None admin] RBAC: Authorizing `identity:get_project(project_id=8ecfc9b2a624461bb3d5c27fa0e48b9e)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:54.694969 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9616eda-0132-4e63-b298-882fe42b6051 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:54.696977 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 212/413] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 24 04:00:54 2022] GET /identity/v3/projects/8ecfc9b2a624461bb3d5c27fa0e48b9e => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:00:54.705498 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9616eda-0132-4e63-b298-882fe42b6051 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:54.772747 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c7a4d-ff1e-43c4-9127-325b59adc739 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:54.813385 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f0288-fbf7-4229-b251-e747e9e8ac02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:54.814509 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f0288-fbf7-4229-b251-e747e9e8ac02 None admin] REQUEST_METHOD: `PUT` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:54.815034 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f0288-fbf7-4229-b251-e747e9e8ac02 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:54.815541 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f0288-fbf7-4229-b251-e747e9e8ac02 None admin] PATH_INFO: `/v3/projects/3d781cc0590648468fbe68aed993b0f3/groups/8cd12e8f879c4d1287bd7ed4fcee92e1/roles/df6a8bb215d54f71a0b6988a9c01f5e4` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:54.817974 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f0288-fbf7-4229-b251-e747e9e8ac02 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d781cc0590648468fbe68aed993b0f3, group_id=8cd12e8f879c4d1287bd7ed4fcee92e1, role_id=df6a8bb215d54f71a0b6988a9c01f5e4)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:54.820379 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34f0288-fbf7-4229-b251-e747e9e8ac02 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:54.825270 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9616eda-0132-4e63-b298-882fe42b6051 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:54.855598 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 202/414] 10.222.0.15 () {58 vars in 1442 bytes} [Wed Aug 24 04:00:54 2022] PUT /identity/v3/projects/3d781cc0590648468fbe68aed993b0f3/groups/8cd12e8f879c4d1287bd7ed4fcee92e1/roles/df6a8bb215d54f71a0b6988a9c01f5e4 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:00:54.879297 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e10f333-c6ec-4334-9062-cda6822a7ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:54.880007 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10f333-c6ec-4334-9062-cda6822a7ef9 None admin] REQUEST_METHOD: `PUT` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:54.880282 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10f333-c6ec-4334-9062-cda6822a7ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:54.880603 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10f333-c6ec-4334-9062-cda6822a7ef9 None admin] PATH_INFO: `/v3/projects/8ecfc9b2a624461bb3d5c27fa0e48b9e/groups/985366e454d242448e3f2b84883169ef/roles/a9f3803644ca4a6fab51b9513141be7b` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:54.885844 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e10f333-c6ec-4334-9062-cda6822a7ef9 None admin] RBAC: Authorizing `identity:create_grant(project_id=8ecfc9b2a624461bb3d5c27fa0e48b9e, group_id=985366e454d242448e3f2b84883169ef, role_id=a9f3803644ca4a6fab51b9513141be7b)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:54.887381 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e10f333-c6ec-4334-9062-cda6822a7ef9 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:54.918242 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 213/415] 10.222.0.15 () {58 vars in 1442 bytes} [Wed Aug 24 04:00:54 2022] PUT /identity/v3/projects/8ecfc9b2a624461bb3d5c27fa0e48b9e/groups/985366e454d242448e3f2b84883169ef/roles/a9f3803644ca4a6fab51b9513141be7b => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:00:55.664835 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b9daf-fae0-4dc8-9135-74fc726a8466 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:55.665368 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b9daf-fae0-4dc8-9135-74fc726a8466 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:55.665368 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b9daf-fae0-4dc8-9135-74fc726a8466 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:55.667061 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 203/416] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:00:55.673103 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f46c3-bcca-44d1-ba98-c73b7ecc5d08 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:55.673607 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f46c3-bcca-44d1-ba98-c73b7ecc5d08 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:55.673680 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f46c3-bcca-44d1-ba98-c73b7ecc5d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:55.699810 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-a84f46c3-bcca-44d1-ba98-c73b7ecc5d08 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:55.701083 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-a84f46c3-bcca-44d1-ba98-c73b7ecc5d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:55.715528 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:55.811622 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 214/417] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:00:55.903497 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55284128-19cb-470b-ac4a-9f64bc5a9fd7 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:55.903776 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55284128-19cb-470b-ac4a-9f64bc5a9fd7 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:55.904044 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55284128-19cb-470b-ac4a-9f64bc5a9fd7 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:55.905685 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 204/418] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:00:55.910709 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b1d5b-9083-464a-8113-460699bea214 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:55.910999 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b1d5b-9083-464a-8113-460699bea214 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:55.911305 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b1d5b-9083-464a-8113-460699bea214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:55.938179 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-675b1d5b-9083-464a-8113-460699bea214 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:55.939382 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-675b1d5b-9083-464a-8113-460699bea214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:56.020604 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 215/419] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:00:56.175111 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55284128-19cb-470b-ac4a-9f64bc5a9fd7 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:56.217939 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:56.311959 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55284128-19cb-470b-ac4a-9f64bc5a9fd7 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:56.350193 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c810d-4d09-4812-8a34-876b81216566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:56.350832 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c810d-4d09-4812-8a34-876b81216566 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:56.351178 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c810d-4d09-4812-8a34-876b81216566 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:56.351495 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c810d-4d09-4812-8a34-876b81216566 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:56.362819 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c810d-4d09-4812-8a34-876b81216566 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:00:56.368354 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-005c810d-4d09-4812-8a34-876b81216566 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:00:56.368354 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:00:56.368354 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:00:56.368354 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:00:56.368354 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:00:56.368354 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:00:56.368354 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:00:56.368354 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:00:56.368354 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:00:56.368354 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:00:56.368354 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:00:56.368354 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:00:56.368354 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:00:56.368354 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:00:56.368354 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:00:56.368354 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:00:56.369238 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:00:56.369238 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:00:56.369238 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:00:56.369238 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:00:56.369238 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:00:56.369238 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:00:56.369238 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:00:56.369238 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:00:56.369238 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:00:56.369238 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:00:56.369238 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:00:56.369238 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:00:56.369238 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:00:56.369238 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:00:56.369238 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:00:56.369238 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:00:56.370026 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:00:56.370026 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:00:56.370026 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:00:56.370026 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:00:56.370026 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:00:56.370026 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:00:56.370026 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:00:56.370026 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:00:56.370026 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:00:56.370026 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:00:56.370026 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:00:56.370026 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:00:56.370026 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 205/420] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 04:00:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:00:56.377095 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b1d5b-9083-464a-8113-460699bea214 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:56.432247 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c810d-4d09-4812-8a34-876b81216566 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:56.498754 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:56.551546 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b1d5b-9083-464a-8113-460699bea214 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:56.587673 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:56.596396 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c810d-4d09-4812-8a34-876b81216566 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:56.619729 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46e47d-ddbf-42db-8139-f1c6dd495e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:56.620611 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46e47d-ddbf-42db-8139-f1c6dd495e58 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:56.620892 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46e47d-ddbf-42db-8139-f1c6dd495e58 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:56.621167 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46e47d-ddbf-42db-8139-f1c6dd495e58 None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:56.621842 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d46e47d-ddbf-42db-8139-f1c6dd495e58 None admin] RBAC: Adding query filter params (name=member) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:56.622149 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d46e47d-ddbf-42db-8139-f1c6dd495e58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:56.623719 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d46e47d-ddbf-42db-8139-f1c6dd495e58 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:56.633195 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 216/421] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 24 04:00:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:00:56.642688 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46e47d-ddbf-42db-8139-f1c6dd495e58 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:56.663077 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db66a4-db7b-471c-8667-d4daa89e5983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:56.664040 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db66a4-db7b-471c-8667-d4daa89e5983 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:56.664462 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db66a4-db7b-471c-8667-d4daa89e5983 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:56.664900 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db66a4-db7b-471c-8667-d4daa89e5983 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:56.696249 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db66a4-db7b-471c-8667-d4daa89e5983 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:00:56.701865 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-d3db66a4-db7b-471c-8667-d4daa89e5983 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:00:56.701865 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:00:56.701865 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:00:56.701865 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:00:56.701865 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:00:56.701865 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:00:56.701865 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:00:56.701865 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:00:56.701865 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:00:56.701865 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:00:56.701865 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:00:56.701865 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:00:56.701865 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:00:56.701865 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:00:56.701865 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:00:56.701865 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:00:56.702893 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:00:56.702893 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:00:56.702893 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:00:56.702893 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:00:56.702893 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:00:56.702893 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:00:56.702893 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:00:56.702893 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:00:56.702893 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:00:56.702893 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:00:56.702893 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:00:56.702893 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:00:56.702893 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:00:56.702893 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:00:56.702893 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:00:56.702893 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:00:56.703852 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:00:56.703852 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:00:56.703852 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:00:56.703852 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:00:56.703852 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:00:56.703852 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:00:56.703852 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:00:56.703852 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:00:56.703852 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:00:56.703852 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:00:56.703852 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:00:56.703852 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:00:56.705756 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 206/422] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Aug 24 04:00:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:00:56.711657 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db66a4-db7b-471c-8667-d4daa89e5983 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:56.797963 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46e47d-ddbf-42db-8139-f1c6dd495e58 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:56.837963 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054bbca8-1830-4082-8240-009e26ebb149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:56.838572 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bbca8-1830-4082-8240-009e26ebb149 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:56.838853 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bbca8-1830-4082-8240-009e26ebb149 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:56.839125 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bbca8-1830-4082-8240-009e26ebb149 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:56.850346 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:56.948733 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db66a4-db7b-471c-8667-d4daa89e5983 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:56.975333 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054bbca8-1830-4082-8240-009e26ebb149 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:56.977850 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054bbca8-1830-4082-8240-009e26ebb149 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:57.001899 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95979ee8-7268-4f19-930d-4fb63464b088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:57.002923 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95979ee8-7268-4f19-930d-4fb63464b088 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:57.003431 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95979ee8-7268-4f19-930d-4fb63464b088 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:57.003896 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95979ee8-7268-4f19-930d-4fb63464b088 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:57.004772 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95979ee8-7268-4f19-930d-4fb63464b088 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:57.005266 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95979ee8-7268-4f19-930d-4fb63464b088 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:57.006860 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95979ee8-7268-4f19-930d-4fb63464b088 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:57.017003 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 207/423] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 24 04:00:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:57.025288 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95979ee8-7268-4f19-930d-4fb63464b088 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:57.066543 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:57.117666 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 217/424] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 24 04:00:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:57.127592 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054bbca8-1830-4082-8240-009e26ebb149 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:57.173913 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:57.204018 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95979ee8-7268-4f19-930d-4fb63464b088 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:57.237484 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054bbca8-1830-4082-8240-009e26ebb149 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:57.240576 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc918e83-80ba-4d3a-b804-cacab21339d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:57.241203 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc918e83-80ba-4d3a-b804-cacab21339d8 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:57.241485 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc918e83-80ba-4d3a-b804-cacab21339d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:57.241799 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc918e83-80ba-4d3a-b804-cacab21339d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:57.272854 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c6b1d-41ac-4bb1-a47b-3c5dba62edc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:57.273499 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c6b1d-41ac-4bb1-a47b-3c5dba62edc3 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:57.273794 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c6b1d-41ac-4bb1-a47b-3c5dba62edc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:57.274044 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c6b1d-41ac-4bb1-a47b-3c5dba62edc3 None admin] PATH_INFO: `/v3/projects/b8831e7463bf44df920eb14d1ccf1502` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:57.275216 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9c6b1d-41ac-4bb1-a47b-3c5dba62edc3 None admin] RBAC: Authorizing `identity:get_project(project_id=b8831e7463bf44df920eb14d1ccf1502)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:57.276704 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9c6b1d-41ac-4bb1-a47b-3c5dba62edc3 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:57.278755 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 218/425] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 24 04:00:57 2022] GET /identity/v3/projects/b8831e7463bf44df920eb14d1ccf1502 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:57.280024 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdaf583-f41a-4c55-beae-84479b9e9f21 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:57.280305 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdaf583-f41a-4c55-beae-84479b9e9f21 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:57.280579 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdaf583-f41a-4c55-beae-84479b9e9f21 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:57.282029 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 219/426] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:00:57.285086 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdaf583-f41a-4c55-beae-84479b9e9f21 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:57.322963 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc918e83-80ba-4d3a-b804-cacab21339d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:57.324675 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc918e83-80ba-4d3a-b804-cacab21339d8 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:57.343030 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:57.392870 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdaf583-f41a-4c55-beae-84479b9e9f21 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:57.407880 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:57.429891 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59bf90-e161-4660-bced-5ec384dd0aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:57.430683 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59bf90-e161-4660-bced-5ec384dd0aed None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:57.431062 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59bf90-e161-4660-bced-5ec384dd0aed None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:57.431452 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59bf90-e161-4660-bced-5ec384dd0aed None admin] PATH_INFO: `/v3/groups/985366e454d242448e3f2b84883169ef` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:57.432732 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f59bf90-e161-4660-bced-5ec384dd0aed None admin] RBAC: Authorizing `identity:get_group(group_id=985366e454d242448e3f2b84883169ef)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:57.434315 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f59bf90-e161-4660-bced-5ec384dd0aed None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:57.436338 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 220/427] 10.222.0.15 () {56 vars in 1180 bytes} [Wed Aug 24 04:00:57 2022] GET /identity/v3/groups/985366e454d242448e3f2b84883169ef => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:57.437754 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573bb76-ead8-4411-9091-0d307e00db22 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:57.438131 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573bb76-ead8-4411-9091-0d307e00db22 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:57.438552 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573bb76-ead8-4411-9091-0d307e00db22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:57.440592 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 208/428] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 24 04:00:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:57.441782 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc918e83-80ba-4d3a-b804-cacab21339d8 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:57.462976 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-0573bb76-ead8-4411-9091-0d307e00db22 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:57.464268 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-0573bb76-ead8-4411-9091-0d307e00db22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:57.539233 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 221/429] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:00:57.539233 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573bb76-ead8-4411-9091-0d307e00db22 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:57.576368 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc918e83-80ba-4d3a-b804-cacab21339d8 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:57.613675 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:57.645387 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd70bf0-d39e-40c1-998d-15a4f254dc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:57.646433 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd70bf0-d39e-40c1-998d-15a4f254dc41 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:57.646908 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd70bf0-d39e-40c1-998d-15a4f254dc41 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:57.647362 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573bb76-ead8-4411-9091-0d307e00db22 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:57.647642 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd70bf0-d39e-40c1-998d-15a4f254dc41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:57.648623 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd70bf0-d39e-40c1-998d-15a4f254dc41 None admin] RBAC: Adding query filter params (group.id=985366e454d242448e3f2b84883169ef, role.id=5d03284e31284f60bcc99e4843279067, scope.project.id=b8831e7463bf44df920eb14d1ccf1502) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:57.654374 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd70bf0-d39e-40c1-998d-15a4f254dc41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:57.655525 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:57.657417 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd70bf0-d39e-40c1-998d-15a4f254dc41 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:57.671677 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 209/430] 10.222.0.15 () {56 vars in 1376 bytes} [Wed Aug 24 04:00:57 2022] GET /identity/v3/role_assignments?group.id=985366e454d242448e3f2b84883169ef&scope.project.id=b8831e7463bf44df920eb14d1ccf1502&role.id=5d03284e31284f60bcc99e4843279067 => generated 611 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:57.693325 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b743a0-a0e8-4c93-b7ab-0ac361a2a628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:57.693989 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b743a0-a0e8-4c93-b7ab-0ac361a2a628 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:57.694631 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b743a0-a0e8-4c93-b7ab-0ac361a2a628 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:57.694940 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b743a0-a0e8-4c93-b7ab-0ac361a2a628 None admin] PATH_INFO: `/v3/projects/b8831e7463bf44df920eb14d1ccf1502` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:57.700264 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b743a0-a0e8-4c93-b7ab-0ac361a2a628 None admin] RBAC: Authorizing `identity:get_project(project_id=b8831e7463bf44df920eb14d1ccf1502)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:57.701762 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b743a0-a0e8-4c93-b7ab-0ac361a2a628 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:57.703650 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 222/431] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 24 04:00:57 2022] GET /identity/v3/projects/b8831e7463bf44df920eb14d1ccf1502 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:57.709442 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd70bf0-d39e-40c1-998d-15a4f254dc41 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:57.749046 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349e663-4a29-40a4-9806-65254c70d96d None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:57.749046 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349e663-4a29-40a4-9806-65254c70d96d None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:57.749046 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349e663-4a29-40a4-9806-65254c70d96d None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:57.749046 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 223/432] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:00:57.761204 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb6b07-772d-4dcd-adfe-d1766eee8f8a None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:57.761540 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb6b07-772d-4dcd-adfe-d1766eee8f8a None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:57.761799 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb6b07-772d-4dcd-adfe-d1766eee8f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:57.792532 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-b7cb6b07-772d-4dcd-adfe-d1766eee8f8a None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:57.793793 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-b7cb6b07-772d-4dcd-adfe-d1766eee8f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:57.869579 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 224/433] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:00:57.870869 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ebc19-1c47-427e-8fa2-9d474a80f954 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:57.871156 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ebc19-1c47-427e-8fa2-9d474a80f954 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:57.871448 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ebc19-1c47-427e-8fa2-9d474a80f954 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:57.873006 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 225/434] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:00:57.873412 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd70bf0-d39e-40c1-998d-15a4f254dc41 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:57.880216 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9aa81-3cd9-418c-be23-4eab2dc6cbe0 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:57.880555 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9aa81-3cd9-418c-be23-4eab2dc6cbe0 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:57.880757 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9aa81-3cd9-418c-be23-4eab2dc6cbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:57.900781 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-75d9aa81-3cd9-418c-be23-4eab2dc6cbe0 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:00:57.902209 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-75d9aa81-3cd9-418c-be23-4eab2dc6cbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:00:57.914141 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c60cf7-fb8d-479e-8013-6785d84bf5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:57.915144 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c60cf7-fb8d-479e-8013-6785d84bf5fe None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:57.915652 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c60cf7-fb8d-479e-8013-6785d84bf5fe None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:57.916159 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c60cf7-fb8d-479e-8013-6785d84bf5fe None admin] PATH_INFO: `/v3/groups/985366e454d242448e3f2b84883169ef` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:57.917537 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c60cf7-fb8d-479e-8013-6785d84bf5fe None admin] RBAC: Authorizing `identity:get_group(group_id=985366e454d242448e3f2b84883169ef)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:57.920170 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c60cf7-fb8d-479e-8013-6785d84bf5fe None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:57.923708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 210/435] 10.222.0.15 () {56 vars in 1180 bytes} [Wed Aug 24 04:00:57 2022] GET /identity/v3/groups/985366e454d242448e3f2b84883169ef => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:57.935551 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c60cf7-fb8d-479e-8013-6785d84bf5fe None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:57.989959 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 226/436] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:00:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:00:58.010149 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:58.021137 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9aa81-3cd9-418c-be23-4eab2dc6cbe0 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:58.057126 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:58.076692 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c60cf7-fb8d-479e-8013-6785d84bf5fe None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:58.114698 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f418e-67bd-4059-a208-39fcabdfa9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:58.115466 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f418e-67bd-4059-a208-39fcabdfa9db None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:58.115812 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f418e-67bd-4059-a208-39fcabdfa9db None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:58.116155 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f418e-67bd-4059-a208-39fcabdfa9db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:58.117014 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07f418e-67bd-4059-a208-39fcabdfa9db None admin] RBAC: Adding query filter params (group.id=985366e454d242448e3f2b84883169ef, role.id=a9f3803644ca4a6fab51b9513141be7b, scope.project.id=b8831e7463bf44df920eb14d1ccf1502) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:58.117385 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07f418e-67bd-4059-a208-39fcabdfa9db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:58.119015 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07f418e-67bd-4059-a208-39fcabdfa9db None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:58.126186 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 211/437] 10.222.0.15 () {56 vars in 1376 bytes} [Wed Aug 24 04:00:57 2022] GET /identity/v3/role_assignments?group.id=985366e454d242448e3f2b84883169ef&scope.project.id=b8831e7463bf44df920eb14d1ccf1502&role.id=a9f3803644ca4a6fab51b9513141be7b => generated 611 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:58.152312 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9aa81-3cd9-418c-be23-4eab2dc6cbe0 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:58.193492 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4372b55-70e8-462d-b30b-d03016590e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:58.194796 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4372b55-70e8-462d-b30b-d03016590e0e None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:58.195296 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4372b55-70e8-462d-b30b-d03016590e0e None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:58.195811 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4372b55-70e8-462d-b30b-d03016590e0e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:58.208706 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4372b55-70e8-462d-b30b-d03016590e0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:00:58.214075 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-d4372b55-70e8-462d-b30b-d03016590e0e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:00:58.214075 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:00:58.214075 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:00:58.214075 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:00:58.214075 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:00:58.214075 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:00:58.214075 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:00:58.214075 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:00:58.214075 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:00:58.214075 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:00:58.214075 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:00:58.214075 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:00:58.214075 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:00:58.214075 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:00:58.214075 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:00:58.214075 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:00:58.215093 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:00:58.215093 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:00:58.215093 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:00:58.215093 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:00:58.215093 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:00:58.215093 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:00:58.215093 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:00:58.215093 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:00:58.215093 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:00:58.215093 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:00:58.215093 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:00:58.215093 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:00:58.215093 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:00:58.215093 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:00:58.215093 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:00:58.215093 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:00:58.215906 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:00:58.215906 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:00:58.215906 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:00:58.215906 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:00:58.215906 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:00:58.215906 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:00:58.215906 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:00:58.215906 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:00:58.215906 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:00:58.215906 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:00:58.215906 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:00:58.215906 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:00:58.222832 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 227/438] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 04:00:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:00:58.226076 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f418e-67bd-4059-a208-39fcabdfa9db None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:58.258873 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4372b55-70e8-462d-b30b-d03016590e0e None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:58.370371 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f418e-67bd-4059-a208-39fcabdfa9db None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:58.390636 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:58.402646 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:58.416606 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4372b55-70e8-462d-b30b-d03016590e0e None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:58.419816 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838eff2f-cf49-4d5f-8c1c-0de38cbc25cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:58.420609 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838eff2f-cf49-4d5f-8c1c-0de38cbc25cb None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:58.421029 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838eff2f-cf49-4d5f-8c1c-0de38cbc25cb None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:58.421461 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838eff2f-cf49-4d5f-8c1c-0de38cbc25cb None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:58.422273 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838eff2f-cf49-4d5f-8c1c-0de38cbc25cb None admin] RBAC: Adding query filter params (name=member) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:58.422570 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838eff2f-cf49-4d5f-8c1c-0de38cbc25cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:58.424252 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838eff2f-cf49-4d5f-8c1c-0de38cbc25cb None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:58.435234 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 212/439] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 24 04:00:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:58.435916 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838eff2f-cf49-4d5f-8c1c-0de38cbc25cb None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:58.460619 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789e30c-771b-4c1b-91e5-5d96d5ee1339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:58.461255 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789e30c-771b-4c1b-91e5-5d96d5ee1339 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:58.461535 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789e30c-771b-4c1b-91e5-5d96d5ee1339 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:58.461810 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789e30c-771b-4c1b-91e5-5d96d5ee1339 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:58.475505 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c789e30c-771b-4c1b-91e5-5d96d5ee1339 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:00:58.480761 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-c789e30c-771b-4c1b-91e5-5d96d5ee1339 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:00:58.480761 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:00:58.480761 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:00:58.480761 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:00:58.480761 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:00:58.480761 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:00:58.480761 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:00:58.480761 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:00:58.480761 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:00:58.480761 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:00:58.480761 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:00:58.480761 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:00:58.480761 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:00:58.480761 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:00:58.480761 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:00:58.480761 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:00:58.481660 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:00:58.481660 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:00:58.481660 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:00:58.481660 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:00:58.481660 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:00:58.481660 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:00:58.481660 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:00:58.481660 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:00:58.481660 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:00:58.481660 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:00:58.481660 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:00:58.481660 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:00:58.481660 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:00:58.481660 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:00:58.481660 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:00:58.481660 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:00:58.482445 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:00:58.482445 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:00:58.482445 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:00:58.482445 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:00:58.482445 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:00:58.482445 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:00:58.482445 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:00:58.482445 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:00:58.482445 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:00:58.482445 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:00:58.482445 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:00:58.482445 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:00:58.484398 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 228/440] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Aug 24 04:00:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:00:58.485351 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789e30c-771b-4c1b-91e5-5d96d5ee1339 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:58.562614 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838eff2f-cf49-4d5f-8c1c-0de38cbc25cb None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:58.602547 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789e30c-771b-4c1b-91e5-5d96d5ee1339 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:58.609566 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560cdf3-e1ed-4e4e-a7d6-8965e483028d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:58.610821 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560cdf3-e1ed-4e4e-a7d6-8965e483028d None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:58.611121 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560cdf3-e1ed-4e4e-a7d6-8965e483028d None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:58.611642 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560cdf3-e1ed-4e4e-a7d6-8965e483028d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:58.630433 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d560cdf3-e1ed-4e4e-a7d6-8965e483028d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:00:58.636446 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-d560cdf3-e1ed-4e4e-a7d6-8965e483028d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:00:58.636446 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:00:58.636446 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:00:58.636446 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:00:58.636446 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:00:58.636446 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:00:58.636446 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:00:58.636446 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:00:58.636446 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:00:58.636446 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:00:58.636446 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:00:58.636446 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:00:58.636446 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:00:58.636446 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:00:58.636446 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:00:58.636446 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:00:58.637384 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:00:58.637384 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:00:58.637384 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:00:58.637384 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:00:58.637384 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:00:58.637384 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:00:58.637384 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:00:58.637384 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:00:58.637384 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:00:58.637384 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:00:58.637384 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:00:58.637384 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:00:58.637384 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:00:58.637384 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:00:58.637384 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:00:58.637384 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:00:58.638164 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:00:58.638164 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:00:58.638164 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:00:58.638164 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:00:58.638164 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:00:58.638164 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:00:58.638164 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:00:58.638164 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:00:58.638164 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:00:58.638164 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:00:58.638164 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:00:58.638164 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:00:58.638164 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 213/441] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 24 04:00:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:00:58.638804 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560cdf3-e1ed-4e4e-a7d6-8965e483028d None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:58.653672 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0686a91-892f-4bc1-bd3f-27a06d0dddc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:58.654285 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0686a91-892f-4bc1-bd3f-27a06d0dddc7 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:58.654562 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0686a91-892f-4bc1-bd3f-27a06d0dddc7 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:58.654858 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0686a91-892f-4bc1-bd3f-27a06d0dddc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:58.679302 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:58.680704 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:58.729540 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0686a91-892f-4bc1-bd3f-27a06d0dddc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:58.731051 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0686a91-892f-4bc1-bd3f-27a06d0dddc7 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:58.754341 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560cdf3-e1ed-4e4e-a7d6-8965e483028d None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:58.796093 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8757b-84ad-4b0a-af56-29734a2b0a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:58.796843 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8757b-84ad-4b0a-af56-29734a2b0a6d None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:58.797256 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8757b-84ad-4b0a-af56-29734a2b0a6d None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:58.797557 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8757b-84ad-4b0a-af56-29734a2b0a6d None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:58.798313 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8757b-84ad-4b0a-af56-29734a2b0a6d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:58.798620 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8757b-84ad-4b0a-af56-29734a2b0a6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:58.800111 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8757b-84ad-4b0a-af56-29734a2b0a6d None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:58.809389 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 214/442] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 24 04:00:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:58.810135 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8757b-84ad-4b0a-af56-29734a2b0a6d None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:58.852062 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 229/443] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 24 04:00:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:58.852964 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0686a91-892f-4bc1-bd3f-27a06d0dddc7 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:58.909507 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:58.918101 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:58.925893 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8757b-84ad-4b0a-af56-29734a2b0a6d None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:58.962125 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0686a91-892f-4bc1-bd3f-27a06d0dddc7 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:58.964499 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a931d4-dffa-4031-856b-621d6164dc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:58.965110 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a931d4-dffa-4031-856b-621d6164dc68 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:58.965389 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a931d4-dffa-4031-856b-621d6164dc68 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:58.965660 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a931d4-dffa-4031-856b-621d6164dc68 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:58.966324 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a931d4-dffa-4031-856b-621d6164dc68 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:58.966628 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a931d4-dffa-4031-856b-621d6164dc68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:58.968051 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a931d4-dffa-4031-856b-621d6164dc68 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:58.976983 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 215/444] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 04:00:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:58.977812 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a931d4-dffa-4031-856b-621d6164dc68 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:58.998134 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d23a0-18dc-4923-b3ba-aca75cf26c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:58.998739 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d23a0-18dc-4923-b3ba-aca75cf26c05 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:58.998998 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d23a0-18dc-4923-b3ba-aca75cf26c05 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:58.999310 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d23a0-18dc-4923-b3ba-aca75cf26c05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:59.069025 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d23a0-18dc-4923-b3ba-aca75cf26c05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:59.070785 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d23a0-18dc-4923-b3ba-aca75cf26c05 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:59.082573 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a931d4-dffa-4031-856b-621d6164dc68 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:59.117356 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2128f8-4979-44d6-a094-b2152925c5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:59.117981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2128f8-4979-44d6-a094-b2152925c5fc None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:59.118254 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2128f8-4979-44d6-a094-b2152925c5fc None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:59.118520 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2128f8-4979-44d6-a094-b2152925c5fc None admin] PATH_INFO: `/v3/projects/8ecfc9b2a624461bb3d5c27fa0e48b9e` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:59.119690 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2128f8-4979-44d6-a094-b2152925c5fc None admin] RBAC: Authorizing `identity:get_project(project_id=8ecfc9b2a624461bb3d5c27fa0e48b9e)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:59.121126 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2128f8-4979-44d6-a094-b2152925c5fc None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:59.122756 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 216/445] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 24 04:00:58 2022] GET /identity/v3/projects/8ecfc9b2a624461bb3d5c27fa0e48b9e => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:59.123906 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:59.128252 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2128f8-4979-44d6-a094-b2152925c5fc None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:59.156304 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:59.172615 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 230/446] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 24 04:00:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:59.173398 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d23a0-18dc-4923-b3ba-aca75cf26c05 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:59.235458 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2128f8-4979-44d6-a094-b2152925c5fc None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:59.269404 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41b321-f5c8-43f5-9bd9-160c8c18a50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:59.270010 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41b321-f5c8-43f5-9bd9-160c8c18a50d None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:59.270287 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41b321-f5c8-43f5-9bd9-160c8c18a50d None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:59.270558 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41b321-f5c8-43f5-9bd9-160c8c18a50d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:59.278503 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d23a0-18dc-4923-b3ba-aca75cf26c05 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:59.316314 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b65c58-35a2-498b-b76e-b896f3f2956f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:59.317062 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b65c58-35a2-498b-b76e-b896f3f2956f None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:59.317351 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b65c58-35a2-498b-b76e-b896f3f2956f None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:59.317601 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b65c58-35a2-498b-b76e-b896f3f2956f None admin] PATH_INFO: `/v3/groups/985366e454d242448e3f2b84883169ef` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:59.318825 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b65c58-35a2-498b-b76e-b896f3f2956f None admin] RBAC: Authorizing `identity:get_group(group_id=985366e454d242448e3f2b84883169ef)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:59.320685 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b65c58-35a2-498b-b76e-b896f3f2956f None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:59.322314 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 231/447] 10.222.0.15 () {56 vars in 1180 bytes} [Wed Aug 24 04:00:59 2022] GET /identity/v3/groups/985366e454d242448e3f2b84883169ef => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:59.323081 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b65c58-35a2-498b-b76e-b896f3f2956f None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:59.347173 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:59.350900 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf41b321-f5c8-43f5-9bd9-160c8c18a50d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:59.353378 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf41b321-f5c8-43f5-9bd9-160c8c18a50d None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:59.381234 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:59.434461 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b65c58-35a2-498b-b76e-b896f3f2956f None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:59.458361 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 217/448] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 24 04:00:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:00:59.459226 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41b321-f5c8-43f5-9bd9-160c8c18a50d None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:59.473841 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7174c-06a8-46e1-9a52-4e84b1cbeb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:59.474471 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7174c-06a8-46e1-9a52-4e84b1cbeb33 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:59.474746 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7174c-06a8-46e1-9a52-4e84b1cbeb33 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:59.475040 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7174c-06a8-46e1-9a52-4e84b1cbeb33 None admin] PATH_INFO: `/v3/projects/8ecfc9b2a624461bb3d5c27fa0e48b9e` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:59.476240 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c7174c-06a8-46e1-9a52-4e84b1cbeb33 None admin] RBAC: Authorizing `identity:get_project(project_id=8ecfc9b2a624461bb3d5c27fa0e48b9e)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:59.477685 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c7174c-06a8-46e1-9a52-4e84b1cbeb33 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:59.479334 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 232/449] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 24 04:00:59 2022] GET /identity/v3/projects/8ecfc9b2a624461bb3d5c27fa0e48b9e => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:59.480086 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7174c-06a8-46e1-9a52-4e84b1cbeb33 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:59.565226 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41b321-f5c8-43f5-9bd9-160c8c18a50d None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:59.569775 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:59.582635 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7174c-06a8-46e1-9a52-4e84b1cbeb33 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:59.593101 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:59.603796 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa117896-b375-47ad-8406-8b8171b970cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:59.604671 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa117896-b375-47ad-8406-8b8171b970cc None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:59.604965 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa117896-b375-47ad-8406-8b8171b970cc None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:59.605240 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa117896-b375-47ad-8406-8b8171b970cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:59.606137 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa117896-b375-47ad-8406-8b8171b970cc None admin] RBAC: Adding query filter params (group.id=985366e454d242448e3f2b84883169ef, role.id=5d03284e31284f60bcc99e4843279067, scope.project.id=8ecfc9b2a624461bb3d5c27fa0e48b9e) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:59.606773 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa117896-b375-47ad-8406-8b8171b970cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:59.608395 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa117896-b375-47ad-8406-8b8171b970cc None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:59.614554 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 218/450] 10.222.0.15 () {56 vars in 1376 bytes} [Wed Aug 24 04:00:59 2022] GET /identity/v3/role_assignments?group.id=985366e454d242448e3f2b84883169ef&scope.project.id=8ecfc9b2a624461bb3d5c27fa0e48b9e&role.id=5d03284e31284f60bcc99e4843279067 => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:59.615575 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa117896-b375-47ad-8406-8b8171b970cc None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:59.617889 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba80b3a4-93d1-4774-97f6-e97d1bfa88b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:59.618532 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80b3a4-93d1-4774-97f6-e97d1bfa88b0 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:59.618812 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80b3a4-93d1-4774-97f6-e97d1bfa88b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:59.619088 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80b3a4-93d1-4774-97f6-e97d1bfa88b0 None admin] PATH_INFO: `/v3/projects/3d781cc0590648468fbe68aed993b0f3` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:59.620365 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba80b3a4-93d1-4774-97f6-e97d1bfa88b0 None admin] RBAC: Authorizing `identity:get_project(project_id=3d781cc0590648468fbe68aed993b0f3)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:59.621876 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba80b3a4-93d1-4774-97f6-e97d1bfa88b0 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:59.628605 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 233/451] 10.222.0.15 () {56 vars in 1186 bytes} [Wed Aug 24 04:00:59 2022] GET /identity/v3/projects/3d781cc0590648468fbe68aed993b0f3 => generated 344 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:59.636702 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba80b3a4-93d1-4774-97f6-e97d1bfa88b0 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:59.732828 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa117896-b375-47ad-8406-8b8171b970cc None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:59.751663 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba80b3a4-93d1-4774-97f6-e97d1bfa88b0 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:59.771877 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57407808-9b7d-4df3-864d-90a4d07d8558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:59.772531 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57407808-9b7d-4df3-864d-90a4d07d8558 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:59.772871 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57407808-9b7d-4df3-864d-90a4d07d8558 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:59.773150 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57407808-9b7d-4df3-864d-90a4d07d8558 None admin] PATH_INFO: `/v3/groups/985366e454d242448e3f2b84883169ef` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:59.774388 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57407808-9b7d-4df3-864d-90a4d07d8558 None admin] RBAC: Authorizing `identity:get_group(group_id=985366e454d242448e3f2b84883169ef)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:59.780310 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57407808-9b7d-4df3-864d-90a4d07d8558 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:59.783255 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 219/452] 10.222.0.15 () {56 vars in 1180 bytes} [Wed Aug 24 04:00:59 2022] GET /identity/v3/groups/985366e454d242448e3f2b84883169ef => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:00:59.788402 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57407808-9b7d-4df3-864d-90a4d07d8558 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:59.801117 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb4a30-bd70-45ce-8f2e-4fe96ae8a921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:59.802947 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb4a30-bd70-45ce-8f2e-4fe96ae8a921 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:59.802947 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb4a30-bd70-45ce-8f2e-4fe96ae8a921 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:59.802947 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb4a30-bd70-45ce-8f2e-4fe96ae8a921 None admin] PATH_INFO: `/v3/groups/8cd12e8f879c4d1287bd7ed4fcee92e1` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:59.804376 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb4a30-bd70-45ce-8f2e-4fe96ae8a921 None admin] RBAC: Authorizing `identity:get_group(group_id=8cd12e8f879c4d1287bd7ed4fcee92e1)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:59.805691 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb4a30-bd70-45ce-8f2e-4fe96ae8a921 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:59.807654 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 234/453] 10.222.0.15 () {56 vars in 1180 bytes} [Wed Aug 24 04:00:59 2022] GET /identity/v3/groups/8cd12e8f879c4d1287bd7ed4fcee92e1 => generated 229 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:00:59.813483 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb4a30-bd70-45ce-8f2e-4fe96ae8a921 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:00:59.843045 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:59.867374 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:00:59.924058 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57407808-9b7d-4df3-864d-90a4d07d8558 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:59.936904 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb4a30-bd70-45ce-8f2e-4fe96ae8a921 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:00:59.967086 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986cb2f0-ab7a-4731-a1af-429278b67bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:59.967758 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cb2f0-ab7a-4731-a1af-429278b67bed None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:59.968041 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cb2f0-ab7a-4731-a1af-429278b67bed None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:59.968313 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cb2f0-ab7a-4731-a1af-429278b67bed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:59.969042 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986cb2f0-ab7a-4731-a1af-429278b67bed None admin] RBAC: Adding query filter params (group.id=985366e454d242448e3f2b84883169ef, role.id=a9f3803644ca4a6fab51b9513141be7b, scope.project.id=8ecfc9b2a624461bb3d5c27fa0e48b9e) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:59.969381 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986cb2f0-ab7a-4731-a1af-429278b67bed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:59.970826 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986cb2f0-ab7a-4731-a1af-429278b67bed None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:00:59.983164 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 220/454] 10.222.0.15 () {56 vars in 1376 bytes} [Wed Aug 24 04:00:59 2022] GET /identity/v3/role_assignments?group.id=985366e454d242448e3f2b84883169ef&scope.project.id=8ecfc9b2a624461bb3d5c27fa0e48b9e&role.id=a9f3803644ca4a6fab51b9513141be7b => generated 611 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:00:59.988928 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc9d4b-5c78-4b40-85ce-97d9d1f0bb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:00:59.989566 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc9d4b-5c78-4b40-85ce-97d9d1f0bb56 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:00:59.989842 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc9d4b-5c78-4b40-85ce-97d9d1f0bb56 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:00:59.990108 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc9d4b-5c78-4b40-85ce-97d9d1f0bb56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:00:59.990866 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc9d4b-5c78-4b40-85ce-97d9d1f0bb56 None admin] RBAC: Adding query filter params (group.id=8cd12e8f879c4d1287bd7ed4fcee92e1, role.id=df6a8bb215d54f71a0b6988a9c01f5e4, scope.project.id=3d781cc0590648468fbe68aed993b0f3) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:00:59.991174 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc9d4b-5c78-4b40-85ce-97d9d1f0bb56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:00:59.993234 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc9d4b-5c78-4b40-85ce-97d9d1f0bb56 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:00.002333 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 235/455] 10.222.0.15 () {56 vars in 1376 bytes} [Wed Aug 24 04:00:59 2022] GET /identity/v3/role_assignments?group.id=8cd12e8f879c4d1287bd7ed4fcee92e1&scope.project.id=3d781cc0590648468fbe68aed993b0f3&role.id=df6a8bb215d54f71a0b6988a9c01f5e4 => generated 611 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:01:02.660506 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb3e54-2c19-4849-be23-0d7e832ebc82 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:02.661051 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb3e54-2c19-4849-be23-0d7e832ebc82 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:02.661051 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb3e54-2c19-4849-be23-0d7e832ebc82 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:02.662788 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 221/456] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:01:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:01:02.668944 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1328e5-b203-4ce9-a5e4-c6e333b0deaf None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:02.669505 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1328e5-b203-4ce9-a5e4-c6e333b0deaf None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:02.669505 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1328e5-b203-4ce9-a5e4-c6e333b0deaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:02.689119 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-fb1328e5-b203-4ce9-a5e4-c6e333b0deaf None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:01:02.690322 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-fb1328e5-b203-4ce9-a5e4-c6e333b0deaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:02.763799 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 236/457] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:01:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:01:02.861411 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3db38-5598-4f39-871e-9b6295e7e389 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:02.861960 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3db38-5598-4f39-871e-9b6295e7e389 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:02.862351 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3db38-5598-4f39-871e-9b6295e7e389 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:02.864249 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 222/458] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:01:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:01:02.870218 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8960d8-10e8-4144-838a-c4196b7db766 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:02.870517 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8960d8-10e8-4144-838a-c4196b7db766 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:02.870774 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8960d8-10e8-4144-838a-c4196b7db766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:02.889383 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-aa8960d8-10e8-4144-838a-c4196b7db766 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:01:02.890879 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-aa8960d8-10e8-4144-838a-c4196b7db766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:02.905773 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:02.967730 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 237/459] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:01:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:01:03.029591 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee4eba-dbc3-405f-9186-e3906a97ad5d None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:03.029879 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee4eba-dbc3-405f-9186-e3906a97ad5d None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:03.030155 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee4eba-dbc3-405f-9186-e3906a97ad5d None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:03.031829 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 223/460] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:01:03.037260 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf3e6d-eeee-4212-b6bb-bdf1fd73fe30 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:03.037542 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf3e6d-eeee-4212-b6bb-bdf1fd73fe30 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:03.037820 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf3e6d-eeee-4212-b6bb-bdf1fd73fe30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:03.057111 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-4faf3e6d-eeee-4212-b6bb-bdf1fd73fe30 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:01:03.058306 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-4faf3e6d-eeee-4212-b6bb-bdf1fd73fe30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:03.091643 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee4eba-dbc3-405f-9186-e3906a97ad5d None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:03.131669 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 238/461] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:01:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:01:03.212261 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee4eba-dbc3-405f-9186-e3906a97ad5d None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:03.238243 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:03.250652 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c7014-87db-439d-8bd8-20231624b2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:03.251317 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c7014-87db-439d-8bd8-20231624b2d7 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:03.251653 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c7014-87db-439d-8bd8-20231624b2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:03.251933 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c7014-87db-439d-8bd8-20231624b2d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:03.263449 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c7014-87db-439d-8bd8-20231624b2d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:03.265008 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c7014-87db-439d-8bd8-20231624b2d7 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:03.280159 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-484c7014-87db-439d-8bd8-20231624b2d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:03.280159 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:03.280159 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:03.280159 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:03.280159 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:03.280159 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:03.280159 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:03.280159 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:03.280159 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:03.280159 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:03.280159 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:03.280159 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:03.280159 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:01:03.280159 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:01:03.280159 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:01:03.280159 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:01:03.281104 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:03.281104 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:03.281104 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:03.281104 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:03.281104 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:03.281104 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:03.281104 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:03.281104 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:03.281104 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:03.281104 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:03.281104 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:03.281104 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:03.281104 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:03.281104 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:03.281104 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:03.281104 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:03.281104 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:01:03.281945 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:01:03.281945 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:03.281945 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:03.281945 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 224/462] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:01:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:03.288614 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf3e6d-eeee-4212-b6bb-bdf1fd73fe30 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:03.325274 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c7014-87db-439d-8bd8-20231624b2d7 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:03.372185 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:03.396197 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf3e6d-eeee-4212-b6bb-bdf1fd73fe30 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:03.432610 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c7014-87db-439d-8bd8-20231624b2d7 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:03.433841 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3683f7-0db7-409c-a04f-f651e9221342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:03.434701 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3683f7-0db7-409c-a04f-f651e9221342 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:03.435886 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3683f7-0db7-409c-a04f-f651e9221342 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:03.436174 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3683f7-0db7-409c-a04f-f651e9221342 None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:03.436830 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3683f7-0db7-409c-a04f-f651e9221342 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:03.437136 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3683f7-0db7-409c-a04f-f651e9221342 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:03.438517 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3683f7-0db7-409c-a04f-f651e9221342 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:03.450949 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 239/463] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 04:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:03.450949 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab6255-4851-4a04-be4f-7a122b359d60 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:03.450949 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab6255-4851-4a04-be4f-7a122b359d60 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:03.450949 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab6255-4851-4a04-be4f-7a122b359d60 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:03.450949 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 240/464] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:01:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:01:03.458671 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab6255-4851-4a04-be4f-7a122b359d60 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:03.476490 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a54e8-0634-48c0-8a18-8daf8c3f7766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:03.477131 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a54e8-0634-48c0-8a18-8daf8c3f7766 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:03.477409 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a54e8-0634-48c0-8a18-8daf8c3f7766 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:03.477690 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a54e8-0634-48c0-8a18-8daf8c3f7766 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:03.489272 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a54e8-0634-48c0-8a18-8daf8c3f7766 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:03.490675 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a54e8-0634-48c0-8a18-8daf8c3f7766 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:03.505748 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-814a54e8-0634-48c0-8a18-8daf8c3f7766 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:03.505748 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:03.505748 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:03.505748 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:03.505748 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:03.505748 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:03.505748 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:03.505748 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:03.505748 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:03.505748 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:03.505748 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:03.505748 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:03.505748 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:01:03.505748 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:01:03.505748 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:01:03.505748 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:01:03.506705 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:03.506705 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:03.506705 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:03.506705 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:03.506705 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:03.506705 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:03.506705 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:03.506705 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:03.506705 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:03.506705 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:03.506705 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:03.506705 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:03.506705 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:03.506705 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:03.506705 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:03.506705 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:03.506705 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:01:03.507664 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:01:03.507664 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:03.507664 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:03.507664 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 225/465] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:01:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:01:03.508487 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ccb2a-0921-4276-a65f-d3666d065276 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:03.508768 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ccb2a-0921-4276-a65f-d3666d065276 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:03.509042 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ccb2a-0921-4276-a65f-d3666d065276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:03.527137 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-ef9ccb2a-0921-4276-a65f-d3666d065276 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:01:03.528405 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-ef9ccb2a-0921-4276-a65f-d3666d065276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:03.549652 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:03.569377 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab6255-4851-4a04-be4f-7a122b359d60 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:03.601181 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 226/466] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:01:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:01:03.602044 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9ccb2a-0921-4276-a65f-d3666d065276 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:03.603541 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fcd32f-2cae-4097-bf68-559c493101ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:03.604149 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcd32f-2cae-4097-bf68-559c493101ff None admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:03.604460 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcd32f-2cae-4097-bf68-559c493101ff None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:03.604698 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcd32f-2cae-4097-bf68-559c493101ff None admin] PATH_INFO: `/v3/users` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:03.605336 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fcd32f-2cae-4097-bf68-559c493101ff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:03.606762 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fcd32f-2cae-4097-bf68-559c493101ff None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:03.617492 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:03.631688 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 241/467] 10.222.0.15 () {60 vars in 1132 bytes} [Wed Aug 24 04:01:03 2022] POST /identity/v3/users => generated 246 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:01:03.632562 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fcd32f-2cae-4097-bf68-559c493101ff None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:03.738869 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9ccb2a-0921-4276-a65f-d3666d065276 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:03.761717 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fcd32f-2cae-4097-bf68-559c493101ff None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:03.780472 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a6aff-78ac-4da0-9048-4129f895cf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:03.781119 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a6aff-78ac-4da0-9048-4129f895cf9b None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:03.781408 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a6aff-78ac-4da0-9048-4129f895cf9b None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:03.781661 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a6aff-78ac-4da0-9048-4129f895cf9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:03.794378 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4a6aff-78ac-4da0-9048-4129f895cf9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:03.796229 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4a6aff-78ac-4da0-9048-4129f895cf9b None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:03.805026 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d348f4-d5b4-4daf-8fe3-3b28ce8f7c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:03.806034 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d348f4-d5b4-4daf-8fe3-3b28ce8f7c2e None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:03.806505 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d348f4-d5b4-4daf-8fe3-3b28ce8f7c2e None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:03.806966 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d348f4-d5b4-4daf-8fe3-3b28ce8f7c2e None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:03.809717 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d348f4-d5b4-4daf-8fe3-3b28ce8f7c2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:03.810536 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d348f4-d5b4-4daf-8fe3-3b28ce8f7c2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:03.813400 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d348f4-d5b4-4daf-8fe3-3b28ce8f7c2e None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:03.819879 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-ec4a6aff-78ac-4da0-9048-4129f895cf9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:03.819879 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:03.819879 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:03.819879 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:03.819879 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:03.819879 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:03.819879 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:03.819879 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:03.819879 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:03.819879 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:03.819879 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:03.819879 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:03.819879 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:01:03.819879 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:01:03.819879 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:01:03.819879 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:01:03.821596 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:03.821596 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:03.821596 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:03.821596 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:03.821596 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:03.821596 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:03.821596 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:03.821596 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:03.821596 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:03.821596 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:03.821596 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:03.821596 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:03.821596 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:03.821596 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:03.821596 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:03.821596 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:03.821596 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:01:03.822882 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:01:03.822882 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:03.822882 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:03.822882 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 227/468] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:01:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:03.833350 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a6aff-78ac-4da0-9048-4129f895cf9b None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:03.841320 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 242/469] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 04:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:03.842707 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d348f4-d5b4-4daf-8fe3-3b28ce8f7c2e None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:03.853967 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:03.920167 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:03.973364 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d348f4-d5b4-4daf-8fe3-3b28ce8f7c2e None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:03.979765 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a6aff-78ac-4da0-9048-4129f895cf9b None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:04.011396 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09c2f9-6f6e-4393-8355-08e296e1efd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:04.012161 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09c2f9-6f6e-4393-8355-08e296e1efd6 None admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:04.012382 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09c2f9-6f6e-4393-8355-08e296e1efd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:04.012683 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09c2f9-6f6e-4393-8355-08e296e1efd6 None admin] PATH_INFO: `/v3/users` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:04.013337 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db09c2f9-6f6e-4393-8355-08e296e1efd6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:04.014792 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db09c2f9-6f6e-4393-8355-08e296e1efd6 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:04.017382 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b36b4-e240-4756-ae50-7e58c7fc9ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:04.018205 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b36b4-e240-4756-ae50-7e58c7fc9ad3 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:04.018675 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b36b4-e240-4756-ae50-7e58c7fc9ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:04.019130 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b36b4-e240-4756-ae50-7e58c7fc9ad3 None admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:04.019987 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b36b4-e240-4756-ae50-7e58c7fc9ad3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:04.020479 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b36b4-e240-4756-ae50-7e58c7fc9ad3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:04.022025 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b36b4-e240-4756-ae50-7e58c7fc9ad3 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:04.036456 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 228/470] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 04:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:04.037389 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b36b4-e240-4756-ae50-7e58c7fc9ad3 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:04.045669 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 243/471] 10.222.0.15 () {60 vars in 1132 bytes} [Wed Aug 24 04:01:03 2022] POST /identity/v3/users => generated 248 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:01:04.046962 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09c2f9-6f6e-4393-8355-08e296e1efd6 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:04.123897 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:04.165854 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b36b4-e240-4756-ae50-7e58c7fc9ad3 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:04.180880 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09c2f9-6f6e-4393-8355-08e296e1efd6 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:04.193341 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:04.209010 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430cbbfe-8919-4146-9203-f6aeacbc32e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:04.210022 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430cbbfe-8919-4146-9203-f6aeacbc32e9 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:04.210483 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430cbbfe-8919-4146-9203-f6aeacbc32e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:04.210965 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430cbbfe-8919-4146-9203-f6aeacbc32e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:04.228658 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430cbbfe-8919-4146-9203-f6aeacbc32e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:04.230172 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430cbbfe-8919-4146-9203-f6aeacbc32e9 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:04.231067 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2d4b4-8cb1-4756-ad58-203a42a14f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:04.231821 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2d4b4-8cb1-4756-ad58-203a42a14f47 None admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:04.232461 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2d4b4-8cb1-4756-ad58-203a42a14f47 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:04.232803 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2d4b4-8cb1-4756-ad58-203a42a14f47 None admin] PATH_INFO: `/v3/users` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:04.234071 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f2d4b4-8cb1-4756-ad58-203a42a14f47 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:04.235823 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f2d4b4-8cb1-4756-ad58-203a42a14f47 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:04.247329 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-430cbbfe-8919-4146-9203-f6aeacbc32e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:04.247329 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:04.247329 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:04.247329 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:04.247329 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:04.247329 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:04.247329 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:04.247329 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:04.247329 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:04.247329 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:04.247329 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:04.247329 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:04.247329 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:01:04.247329 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:01:04.247329 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:01:04.247329 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:01:04.248302 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:04.248302 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:04.248302 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:04.248302 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:04.248302 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:04.248302 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:04.248302 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:04.248302 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:04.248302 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:04.248302 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:04.248302 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:04.248302 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:04.248302 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:04.248302 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:04.248302 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:04.248302 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:04.248302 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:01:04.249139 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:01:04.249139 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:04.249139 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:04.249139 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 229/472] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:01:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:04.255557 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430cbbfe-8919-4146-9203-f6aeacbc32e9 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:04.268534 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 244/473] 10.222.0.15 () {60 vars in 1132 bytes} [Wed Aug 24 04:01:04 2022] POST /identity/v3/users => generated 248 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:01:04.387451 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430cbbfe-8919-4146-9203-f6aeacbc32e9 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:04.410690 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:04.428850 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3143637e-8641-4b3c-a9a8-78db71205f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:04.429912 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143637e-8641-4b3c-a9a8-78db71205f4f None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:04.430388 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143637e-8641-4b3c-a9a8-78db71205f4f None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:04.430870 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143637e-8641-4b3c-a9a8-78db71205f4f None admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:04.431892 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3143637e-8641-4b3c-a9a8-78db71205f4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:04.432417 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3143637e-8641-4b3c-a9a8-78db71205f4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:04.434148 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3143637e-8641-4b3c-a9a8-78db71205f4f None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:04.449164 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 230/474] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 04:01:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:01:04.455114 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2d4b4-8cb1-4756-ad58-203a42a14f47 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:04.567615 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2d4b4-8cb1-4756-ad58-203a42a14f47 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:04.605754 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45b9df-e1e4-4c20-a5e0-96c95dbbed4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:04.606363 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45b9df-e1e4-4c20-a5e0-96c95dbbed4d None admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:04.606648 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45b9df-e1e4-4c20-a5e0-96c95dbbed4d None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:04.606920 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45b9df-e1e4-4c20-a5e0-96c95dbbed4d None admin] PATH_INFO: `/v3/users` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:04.607608 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f45b9df-e1e4-4c20-a5e0-96c95dbbed4d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:04.609066 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f45b9df-e1e4-4c20-a5e0-96c95dbbed4d None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:04.639381 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 245/475] 10.222.0.15 () {60 vars in 1132 bytes} [Wed Aug 24 04:01:04 2022] POST /identity/v3/users => generated 249 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:01:06.001877 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7289c-1e8f-4462-9117-16faa0efce85 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:06.002877 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7289c-1e8f-4462-9117-16faa0efce85 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:06.003380 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7289c-1e8f-4462-9117-16faa0efce85 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:06.005174 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 231/476] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:01:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:01:06.010293 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce264f-92c3-4b69-8144-8aee83bcda47 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:06.010760 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce264f-92c3-4b69-8144-8aee83bcda47 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:06.010837 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce264f-92c3-4b69-8144-8aee83bcda47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:06.030375 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-07ce264f-92c3-4b69-8144-8aee83bcda47 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:01:06.031642 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-07ce264f-92c3-4b69-8144-8aee83bcda47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:06.049881 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:06.110042 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 246/477] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:01:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:01:06.439754 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a49dd8-6aac-465c-a647-992bc303265c None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:06.440303 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a49dd8-6aac-465c-a647-992bc303265c None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:06.440586 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a49dd8-6aac-465c-a647-992bc303265c None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:06.442080 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 232/478] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:01:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:01:06.442990 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce264f-92c3-4b69-8144-8aee83bcda47 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:06.449424 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb348a-b66a-41aa-82db-921fd6b3a3d1 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:06.449993 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb348a-b66a-41aa-82db-921fd6b3a3d1 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:06.450455 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb348a-b66a-41aa-82db-921fd6b3a3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:06.470502 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-66bb348a-b66a-41aa-82db-921fd6b3a3d1 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:01:06.472312 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-66bb348a-b66a-41aa-82db-921fd6b3a3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:06.554988 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 233/479] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:01:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:01:06.566258 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce264f-92c3-4b69-8144-8aee83bcda47 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:06.607017 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5673e54a-76b3-478d-b46c-6114061f2d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:06.607735 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673e54a-76b3-478d-b46c-6114061f2d71 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:06.608018 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673e54a-76b3-478d-b46c-6114061f2d71 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:06.608289 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673e54a-76b3-478d-b46c-6114061f2d71 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:06.619816 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5673e54a-76b3-478d-b46c-6114061f2d71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:01:06.624644 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-5673e54a-76b3-478d-b46c-6114061f2d71 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:01:06.624644 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:06.624644 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:06.624644 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:06.624644 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:06.624644 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:06.624644 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:06.624644 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:06.624644 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:06.624644 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:06.624644 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:06.624644 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:06.624644 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:01:06.624644 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:01:06.624644 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:01:06.624644 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:01:06.625526 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:01:06.625526 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:01:06.625526 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:01:06.625526 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:01:06.625526 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:06.625526 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:06.625526 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:06.625526 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:06.625526 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:06.625526 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:06.625526 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:06.625526 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:06.625526 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:06.625526 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:06.625526 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:06.625526 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:06.626286 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:06.626286 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:06.626286 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:06.626286 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:06.626286 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:01:06.626286 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:01:06.626286 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:01:06.626286 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:01:06.626286 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:01:06.626286 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:01:06.626286 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:01:06.626286 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:06.626286 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 247/480] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Aug 24 04:01:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:06.633592 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb348a-b66a-41aa-82db-921fd6b3a3d1 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:06.657723 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8251b9-76cf-4c7f-9a81-b3cf4035e0d1 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:06.658017 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8251b9-76cf-4c7f-9a81-b3cf4035e0d1 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:06.658289 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8251b9-76cf-4c7f-9a81-b3cf4035e0d1 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:06.659891 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 248/481] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:01:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:01:06.666195 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae272b9-3760-4054-ab04-19744d0460bf None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:06.666195 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae272b9-3760-4054-ab04-19744d0460bf None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:06.666195 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae272b9-3760-4054-ab04-19744d0460bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:06.689337 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-fae272b9-3760-4054-ab04-19744d0460bf None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:01:06.691102 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-fae272b9-3760-4054-ab04-19744d0460bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:06.702413 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:06.751712 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb348a-b66a-41aa-82db-921fd6b3a3d1 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:06.767060 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:06.795564 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 249/482] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:01:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:01:06.803346 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e812d1e-2c70-4624-bb81-45f56f65347a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:06.804279 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e812d1e-2c70-4624-bb81-45f56f65347a None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:06.804786 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e812d1e-2c70-4624-bb81-45f56f65347a None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:06.805256 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e812d1e-2c70-4624-bb81-45f56f65347a None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:06.806131 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e812d1e-2c70-4624-bb81-45f56f65347a None admin] RBAC: Adding query filter params (name=service) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:06.806698 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e812d1e-2c70-4624-bb81-45f56f65347a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:06.808373 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e812d1e-2c70-4624-bb81-45f56f65347a None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:06.818303 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 234/483] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Aug 24 04:01:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:06.823941 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae272b9-3760-4054-ab04-19744d0460bf None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:06.897164 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e812d1e-2c70-4624-bb81-45f56f65347a None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:06.945288 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae272b9-3760-4054-ab04-19744d0460bf None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:06.985932 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e574609-c992-4791-95db-063bb46bc72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:06.986648 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e574609-c992-4791-95db-063bb46bc72e None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:06.986941 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e574609-c992-4791-95db-063bb46bc72e None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:06.987331 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e574609-c992-4791-95db-063bb46bc72e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:06.999050 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e574609-c992-4791-95db-063bb46bc72e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:07.003898 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e574609-c992-4791-95db-063bb46bc72e None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:07.006232 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:07.015604 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e812d1e-2c70-4624-bb81-45f56f65347a None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:07.019947 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-3e574609-c992-4791-95db-063bb46bc72e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:07.019947 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:07.019947 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:07.019947 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:07.019947 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:07.019947 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:07.019947 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:07.019947 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:07.019947 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:07.019947 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:07.019947 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:07.019947 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:07.019947 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:01:07.019947 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:01:07.019947 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:01:07.019947 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:01:07.026180 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:07.026180 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:07.026180 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:07.026180 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:07.026180 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:07.026180 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:07.026180 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:07.026180 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:07.026180 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:07.026180 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:07.026180 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:07.026180 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:07.026180 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:07.026180 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:07.026180 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:07.026180 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:07.026180 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:01:07.027096 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:01:07.027096 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:07.027096 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:07.027096 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 250/484] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:01:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:01:07.027096 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a4c02-34fc-49ad-b4bd-04ef94233d4b None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:07.027096 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a4c02-34fc-49ad-b4bd-04ef94233d4b None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:07.027096 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a4c02-34fc-49ad-b4bd-04ef94233d4b None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:07.027096 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 251/485] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:01:07.027560 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a4c02-34fc-49ad-b4bd-04ef94233d4b None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:07.064788 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9148d-07c3-4b90-834d-44e533f7f12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:07.065424 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9148d-07c3-4b90-834d-44e533f7f12f None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:07.065696 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9148d-07c3-4b90-834d-44e533f7f12f None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:07.065962 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9148d-07c3-4b90-834d-44e533f7f12f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:07.077033 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab9148d-07c3-4b90-834d-44e533f7f12f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:01:07.082131 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-9ab9148d-07c3-4b90-834d-44e533f7f12f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:01:07.082131 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:07.082131 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:07.082131 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:07.082131 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:07.082131 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:07.082131 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:07.082131 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:07.082131 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:07.082131 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:07.082131 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:07.082131 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:07.082131 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:01:07.082131 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:01:07.082131 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:01:07.082131 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:01:07.083059 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:01:07.083059 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:01:07.083059 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:01:07.083059 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:01:07.083059 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:07.083059 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:07.083059 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:07.083059 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:07.083059 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:07.083059 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:07.083059 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:07.083059 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:07.083059 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:07.083059 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:07.083059 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:07.083059 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:07.084954 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:07.084954 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:07.084954 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:07.084954 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:07.084954 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:01:07.084954 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:01:07.084954 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:01:07.084954 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:01:07.084954 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:01:07.084954 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:01:07.084954 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:01:07.084954 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:07.084954 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 235/486] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Aug 24 04:01:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:01:07.084954 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ff589-0e72-4bb8-875f-21188802ae72 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:07.085798 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ff589-0e72-4bb8-875f-21188802ae72 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:07.085798 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ff589-0e72-4bb8-875f-21188802ae72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:07.104946 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-503ff589-0e72-4bb8-875f-21188802ae72 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:01:07.106135 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-503ff589-0e72-4bb8-875f-21188802ae72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:07.136077 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:07.147247 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a4c02-34fc-49ad-b4bd-04ef94233d4b None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:07.183613 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc1702-edf2-437d-94a5-eeda27ab4447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:07.184216 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc1702-edf2-437d-94a5-eeda27ab4447 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:07.184469 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc1702-edf2-437d-94a5-eeda27ab4447 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:07.184744 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc1702-edf2-437d-94a5-eeda27ab4447 None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:07.185471 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc1702-edf2-437d-94a5-eeda27ab4447 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:07.185777 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc1702-edf2-437d-94a5-eeda27ab4447 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:07.187157 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc1702-edf2-437d-94a5-eeda27ab4447 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:07.187657 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 236/487] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:01:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:01:07.188336 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ff589-0e72-4bb8-875f-21188802ae72 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:07.204006 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 252/488] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 04:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:01:07.204006 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc1702-edf2-437d-94a5-eeda27ab4447 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:07.266000 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:07.296645 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ff589-0e72-4bb8-875f-21188802ae72 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:07.321293 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc1702-edf2-437d-94a5-eeda27ab4447 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:07.333327 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235af2e-8368-4010-a4be-7959c75a2bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:07.333952 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235af2e-8368-4010-a4be-7959c75a2bba None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:07.334211 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235af2e-8368-4010-a4be-7959c75a2bba None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:07.334462 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235af2e-8368-4010-a4be-7959c75a2bba None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:07.335223 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235af2e-8368-4010-a4be-7959c75a2bba None admin] RBAC: Adding query filter params (name=service) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:07.335521 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235af2e-8368-4010-a4be-7959c75a2bba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:07.336896 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235af2e-8368-4010-a4be-7959c75a2bba None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:07.345309 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 237/489] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Aug 24 04:01:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:07.346113 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235af2e-8368-4010-a4be-7959c75a2bba None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:07.364684 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba194d-f573-4257-b56c-41c225406a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:07.365635 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba194d-f573-4257-b56c-41c225406a32 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:07.366242 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba194d-f573-4257-b56c-41c225406a32 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:07.366682 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba194d-f573-4257-b56c-41c225406a32 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:07.373953 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:07.382130 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba194d-f573-4257-b56c-41c225406a32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:01:07.387594 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-8aba194d-f573-4257-b56c-41c225406a32 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:01:07.387594 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:07.387594 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:07.387594 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:07.387594 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:07.387594 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:07.387594 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:07.387594 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:07.387594 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:07.387594 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:07.387594 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:07.387594 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:07.387594 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:01:07.387594 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:01:07.387594 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:01:07.387594 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:01:07.388513 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:01:07.388513 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:01:07.388513 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:01:07.388513 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:01:07.388513 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:07.388513 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:07.388513 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:07.388513 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:07.388513 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:07.388513 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:07.388513 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:07.388513 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:07.388513 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:07.388513 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:07.388513 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:07.388513 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:07.389447 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:07.389447 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:07.389447 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:07.389447 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:07.389447 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:01:07.389447 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:01:07.389447 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:01:07.389447 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:01:07.389447 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:01:07.389447 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:01:07.389447 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:01:07.389447 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:07.391348 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 253/490] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Aug 24 04:01:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:07.392280 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba194d-f573-4257-b56c-41c225406a32 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:07.467582 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235af2e-8368-4010-a4be-7959c75a2bba None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:07.504796 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c950c2b-6852-4924-b0d6-e3f4ec51deab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:07.505435 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c950c2b-6852-4924-b0d6-e3f4ec51deab None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:07.505708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c950c2b-6852-4924-b0d6-e3f4ec51deab None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:07.505975 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c950c2b-6852-4924-b0d6-e3f4ec51deab None admin] PATH_INFO: `/v3/users/nova` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:07.507745 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba194d-f573-4257-b56c-41c225406a32 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:07.513858 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c950c2b-6852-4924-b0d6-e3f4ec51deab None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:07.516033 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c950c2b-6852-4924-b0d6-e3f4ec51deab None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:07.521612 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:07.532110 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-3c950c2b-6852-4924-b0d6-e3f4ec51deab None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:01:07.532110 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:07.532110 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:07.532110 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:07.532110 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:07.532110 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:07.532110 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:07.532110 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:07.532110 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:07.532110 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:07.532110 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:07.532110 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:07.532110 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:01:07.532110 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:01:07.532110 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:01:07.532110 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:01:07.533050 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:07.533050 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:07.533050 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:01:07.533050 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:01:07.533050 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:01:07.533050 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:01:07.533050 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:07.533050 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:07.533050 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:07.533050 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:07.533050 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:07.533050 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:07.533050 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:07.533050 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:07.533050 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:07.533050 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:07.533050 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:07.533050 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:07.533933 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:07.533933 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:07.533933 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:01:07.533933 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:01:07.533933 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:01:07.533933 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:01:07.533933 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:01:07.533933 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:01:07.533933 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:01:07.533933 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:07.533933 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 238/491] 10.222.0.15 () {56 vars in 1093 bytes} [Wed Aug 24 04:01:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:07.534827 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c950c2b-6852-4924-b0d6-e3f4ec51deab None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:07.546543 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75757b81-dd59-47e7-b2d7-f262a4b6055d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:07.547169 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75757b81-dd59-47e7-b2d7-f262a4b6055d None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:07.547478 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75757b81-dd59-47e7-b2d7-f262a4b6055d None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:07.547749 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75757b81-dd59-47e7-b2d7-f262a4b6055d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:07.558778 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75757b81-dd59-47e7-b2d7-f262a4b6055d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:07.560247 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75757b81-dd59-47e7-b2d7-f262a4b6055d None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:07.575254 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-75757b81-dd59-47e7-b2d7-f262a4b6055d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:07.575254 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:07.575254 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:07.575254 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:07.575254 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:07.575254 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:07.575254 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:07.575254 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:07.575254 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:07.575254 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:07.575254 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:07.575254 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:07.575254 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:01:07.575254 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:01:07.575254 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:01:07.575254 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:01:07.576197 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:07.576197 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:07.576197 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:07.576197 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:07.576197 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:07.576197 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:07.576197 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:07.576197 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:07.576197 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:07.576197 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:07.576197 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:07.576197 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:07.576197 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:07.576197 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:07.576197 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:07.576197 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:07.576197 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:01:07.577015 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:01:07.577015 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:07.577015 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:07.581232 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 254/492] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:01:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:07.582002 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75757b81-dd59-47e7-b2d7-f262a4b6055d None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:07.622545 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:07.640008 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c950c2b-6852-4924-b0d6-e3f4ec51deab None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:07.673804 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca59b7e7-4f78-4f5b-b6da-440007532767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:07.674421 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59b7e7-4f78-4f5b-b6da-440007532767 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:07.674702 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59b7e7-4f78-4f5b-b6da-440007532767 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:07.674976 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59b7e7-4f78-4f5b-b6da-440007532767 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:07.675677 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca59b7e7-4f78-4f5b-b6da-440007532767 None admin] RBAC: Adding query filter params (name=service) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:07.675981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca59b7e7-4f78-4f5b-b6da-440007532767 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:07.677379 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca59b7e7-4f78-4f5b-b6da-440007532767 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:07.683395 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75757b81-dd59-47e7-b2d7-f262a4b6055d None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:07.685432 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 239/493] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Aug 24 04:01:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:07.686228 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca59b7e7-4f78-4f5b-b6da-440007532767 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:07.723313 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8d609-7e7b-4b50-9c07-67bf34de95f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:07.723899 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8d609-7e7b-4b50-9c07-67bf34de95f3 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:07.724175 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8d609-7e7b-4b50-9c07-67bf34de95f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:07.724446 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8d609-7e7b-4b50-9c07-67bf34de95f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:07.736776 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e8d609-7e7b-4b50-9c07-67bf34de95f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:01:07.742269 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-45e8d609-7e7b-4b50-9c07-67bf34de95f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:01:07.742269 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:07.742269 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:07.742269 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:07.742269 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:07.742269 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:07.742269 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:07.742269 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:07.742269 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:07.742269 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:07.742269 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:07.742269 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:07.742269 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:01:07.742269 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:01:07.742269 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:01:07.742269 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:01:07.743457 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:01:07.743457 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:01:07.743457 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:01:07.743457 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:01:07.743457 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:07.743457 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:07.743457 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:07.743457 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:07.743457 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:07.743457 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:07.743457 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:07.743457 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:07.743457 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:07.743457 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:07.743457 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:07.743457 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:07.744284 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:07.744284 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:07.744284 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:07.744284 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:07.744284 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:01:07.744284 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:01:07.744284 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:01:07.744284 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:01:07.744284 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:01:07.744284 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:01:07.744284 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:01:07.744284 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:07.744284 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 255/494] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Aug 24 04:01:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:07.744923 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8d609-7e7b-4b50-9c07-67bf34de95f3 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:07.773677 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:07.797073 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca59b7e7-4f78-4f5b-b6da-440007532767 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:07.837171 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de8ffe-0a4e-4546-84c2-55aba357b0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:07.837896 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de8ffe-0a4e-4546-84c2-55aba357b0af None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:07.838177 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de8ffe-0a4e-4546-84c2-55aba357b0af None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:07.838437 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de8ffe-0a4e-4546-84c2-55aba357b0af None admin] PATH_INFO: `/v3/users` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:07.839168 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de8ffe-0a4e-4546-84c2-55aba357b0af None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:07.839588 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de8ffe-0a4e-4546-84c2-55aba357b0af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:07.841001 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de8ffe-0a4e-4546-84c2-55aba357b0af None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:07.851241 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8d609-7e7b-4b50-9c07-67bf34de95f3 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:07.880349 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 240/495] 10.222.0.15 () {56 vars in 1133 bytes} [Wed Aug 24 04:01:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:07.881778 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de8ffe-0a4e-4546-84c2-55aba357b0af None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:07.890020 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:07.894220 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4254214-4f86-4cbf-877a-08c39b3346e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:07.894220 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4254214-4f86-4cbf-877a-08c39b3346e8 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:07.894220 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4254214-4f86-4cbf-877a-08c39b3346e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:07.894220 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4254214-4f86-4cbf-877a-08c39b3346e8 None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:07.894567 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4254214-4f86-4cbf-877a-08c39b3346e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:07.894567 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4254214-4f86-4cbf-877a-08c39b3346e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:07.895738 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4254214-4f86-4cbf-877a-08c39b3346e8 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:07.908949 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 256/496] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 04:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:07.910093 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4254214-4f86-4cbf-877a-08c39b3346e8 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:07.989568 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de8ffe-0a4e-4546-84c2-55aba357b0af None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:08.000141 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:08.015713 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4254214-4f86-4cbf-877a-08c39b3346e8 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:08.025067 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82246fa3-fc74-4bb3-8cf4-bd7bd9a1baf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:08.025700 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82246fa3-fc74-4bb3-8cf4-bd7bd9a1baf4 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:08.025974 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82246fa3-fc74-4bb3-8cf4-bd7bd9a1baf4 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:08.026244 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82246fa3-fc74-4bb3-8cf4-bd7bd9a1baf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:08.036455 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82246fa3-fc74-4bb3-8cf4-bd7bd9a1baf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:08.037975 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82246fa3-fc74-4bb3-8cf4-bd7bd9a1baf4 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:08.050861 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f3d4e4-c4f7-49d9-9772-eadc595ee91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:08.051495 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3d4e4-c4f7-49d9-9772-eadc595ee91f None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:08.051776 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3d4e4-c4f7-49d9-9772-eadc595ee91f None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:08.052050 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3d4e4-c4f7-49d9-9772-eadc595ee91f None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:08.052715 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f3d4e4-c4f7-49d9-9772-eadc595ee91f None admin] RBAC: Adding query filter params (name=service) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:08.052805 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-82246fa3-fc74-4bb3-8cf4-bd7bd9a1baf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:08.052805 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:08.052805 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:08.052805 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:08.052805 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:08.052805 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:08.052805 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:08.052805 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:08.052805 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:08.052805 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:08.052805 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:08.052805 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:08.052805 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:01:08.052805 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:01:08.052805 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:01:08.052805 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:01:08.053708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:08.053708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:08.053708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:08.053708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:08.053708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:08.053708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:08.053708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:08.053708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:08.053708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:08.053708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:08.053708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:08.053708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:08.053708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:08.053708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:08.053708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:08.053708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:08.053708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:01:08.054550 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:01:08.054550 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:08.054550 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:08.054708 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f3d4e4-c4f7-49d9-9772-eadc595ee91f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:08.054782 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 241/497] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:01:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:08.054848 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f3d4e4-c4f7-49d9-9772-eadc595ee91f None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:08.054912 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82246fa3-fc74-4bb3-8cf4-bd7bd9a1baf4 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:08.067466 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 257/498] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Aug 24 04:01:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:08.067466 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f3d4e4-c4f7-49d9-9772-eadc595ee91f None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:08.114700 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:08.163587 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82246fa3-fc74-4bb3-8cf4-bd7bd9a1baf4 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:08.170673 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f3d4e4-c4f7-49d9-9772-eadc595ee91f None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:08.200095 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa52ede-eb0d-43a1-a9aa-8b963a7273f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:08.200716 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa52ede-eb0d-43a1-a9aa-8b963a7273f0 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:08.200993 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa52ede-eb0d-43a1-a9aa-8b963a7273f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:08.201263 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa52ede-eb0d-43a1-a9aa-8b963a7273f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:08.207835 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81dce78-e12b-426b-b433-799094a5f2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:08.208477 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81dce78-e12b-426b-b433-799094a5f2ef None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:08.208760 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81dce78-e12b-426b-b433-799094a5f2ef None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:08.209033 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81dce78-e12b-426b-b433-799094a5f2ef None admin] PATH_INFO: `/v3/users/glance` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:08.217583 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81dce78-e12b-426b-b433-799094a5f2ef None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:08.219067 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81dce78-e12b-426b-b433-799094a5f2ef None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:08.233776 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-e81dce78-e12b-426b-b433-799094a5f2ef None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 04:01:08.233776 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:08.233776 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:08.233776 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:08.233776 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:08.233776 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:08.233776 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:08.233776 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:08.233776 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:08.233776 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:08.233776 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:08.233776 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:08.233776 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:01:08.233776 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:01:08.233776 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:01:08.233776 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:01:08.234917 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:08.234917 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:08.234917 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:01:08.234917 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:01:08.234917 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:01:08.234917 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:01:08.234917 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:08.234917 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:08.234917 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:08.234917 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:08.234917 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:08.234917 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:08.234917 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:08.234917 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:08.234917 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:08.234917 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:08.234917 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:08.234917 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:08.236057 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:08.236057 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:08.236057 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:01:08.236057 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:01:08.236057 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:01:08.236057 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:01:08.236057 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:01:08.236057 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:01:08.236057 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 04:01:08.236057 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:08.236057 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 258/499] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 04:01:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:08.236057 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81dce78-e12b-426b-b433-799094a5f2ef None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:08.249123 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:08.278983 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa52ede-eb0d-43a1-a9aa-8b963a7273f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:08.280545 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa52ede-eb0d-43a1-a9aa-8b963a7273f0 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:08.335362 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:08.346851 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81dce78-e12b-426b-b433-799094a5f2ef None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:08.380747 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 242/500] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 24 04:01:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:08.380995 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc67fce3-e8e6-4e48-835c-17277063d024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:08.381378 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67fce3-e8e6-4e48-835c-17277063d024 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:08.381580 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa52ede-eb0d-43a1-a9aa-8b963a7273f0 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:08.381677 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67fce3-e8e6-4e48-835c-17277063d024 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:08.382018 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67fce3-e8e6-4e48-835c-17277063d024 None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:08.382689 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc67fce3-e8e6-4e48-835c-17277063d024 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:08.382991 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc67fce3-e8e6-4e48-835c-17277063d024 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:08.384418 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc67fce3-e8e6-4e48-835c-17277063d024 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:08.397622 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 259/501] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 04:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:08.398460 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc67fce3-e8e6-4e48-835c-17277063d024 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:08.466761 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:08.486717 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa52ede-eb0d-43a1-a9aa-8b963a7273f0 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:08.500074 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc67fce3-e8e6-4e48-835c-17277063d024 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:08.521570 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948a114-24c0-4888-9364-d04018063b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:08.522197 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948a114-24c0-4888-9364-d04018063b75 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:08.522589 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948a114-24c0-4888-9364-d04018063b75 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:08.522854 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948a114-24c0-4888-9364-d04018063b75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:08.533163 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a948a114-24c0-4888-9364-d04018063b75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:08.533299 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d832c-332b-4d21-998b-6531d9b3fc5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:08.533797 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d832c-332b-4d21-998b-6531d9b3fc5f None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:08.534076 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d832c-332b-4d21-998b-6531d9b3fc5f None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:08.534344 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d832c-332b-4d21-998b-6531d9b3fc5f None admin] PATH_INFO: `/v3/users` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:08.534633 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a948a114-24c0-4888-9364-d04018063b75 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:08.535068 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8d832c-332b-4d21-998b-6531d9b3fc5f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:08.535401 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8d832c-332b-4d21-998b-6531d9b3fc5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:08.536820 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8d832c-332b-4d21-998b-6531d9b3fc5f None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:08.549384 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-a948a114-24c0-4888-9364-d04018063b75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:08.549384 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:08.549384 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:08.549384 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:08.549384 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:08.549384 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:08.549384 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:08.549384 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:08.549384 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:08.549384 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:08.549384 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:08.549384 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:08.549384 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:01:08.549384 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:01:08.549384 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:01:08.549384 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:01:08.550300 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:08.550300 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:08.550300 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:08.550300 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:08.550300 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:08.550300 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:08.550300 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:08.550300 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:08.550300 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:08.550300 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:08.550300 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:08.550300 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:08.550300 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:08.550300 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:08.550300 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:08.550300 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:08.550300 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:01:08.551128 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:01:08.551128 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:08.551128 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:08.551128 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 243/502] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:01:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:08.551371 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948a114-24c0-4888-9364-d04018063b75 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:08.563966 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:08.578263 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 260/503] 10.222.0.15 () {56 vars in 1137 bytes} [Wed Aug 24 04:01:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:08.579220 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d832c-332b-4d21-998b-6531d9b3fc5f None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:08.658540 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948a114-24c0-4888-9364-d04018063b75 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:08.681037 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d832c-332b-4d21-998b-6531d9b3fc5f None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:08.693204 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32a27a-1030-48d5-a17d-5e3fc57b61af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:08.693839 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32a27a-1030-48d5-a17d-5e3fc57b61af None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:08.694457 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32a27a-1030-48d5-a17d-5e3fc57b61af None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:08.694725 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32a27a-1030-48d5-a17d-5e3fc57b61af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:08.705975 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c32a27a-1030-48d5-a17d-5e3fc57b61af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:08.707486 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c32a27a-1030-48d5-a17d-5e3fc57b61af None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:08.708565 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:08.718043 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196bec20-909d-4e2e-a839-b60923b6e0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:08.718672 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bec20-909d-4e2e-a839-b60923b6e0c8 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:08.718954 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bec20-909d-4e2e-a839-b60923b6e0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:08.719243 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bec20-909d-4e2e-a839-b60923b6e0c8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:08.722546 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-2c32a27a-1030-48d5-a17d-5e3fc57b61af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:08.722546 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:08.722546 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:08.722546 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:08.722546 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:08.722546 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:08.722546 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:08.722546 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:08.722546 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:08.722546 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:08.722546 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:08.722546 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:08.722546 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:01:08.722546 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:01:08.722546 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:01:08.722546 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:01:08.723622 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:08.723622 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:08.723622 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:08.723622 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:08.723622 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:08.723622 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:08.723622 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:08.723622 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:08.723622 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:08.723622 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:08.723622 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:08.723622 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:08.723622 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:08.723622 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:08.723622 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:08.723622 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:08.723622 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:01:08.725023 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:01:08.725023 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:08.725023 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:08.725023 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 244/504] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:01:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:08.725023 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32a27a-1030-48d5-a17d-5e3fc57b61af None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:08.726637 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196bec20-909d-4e2e-a839-b60923b6e0c8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:08.728143 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196bec20-909d-4e2e-a839-b60923b6e0c8 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:08.740883 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-196bec20-909d-4e2e-a839-b60923b6e0c8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 04:01:08.740883 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:08.740883 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:08.740883 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:08.740883 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:08.740883 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:08.740883 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:08.740883 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:08.740883 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:08.740883 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:08.740883 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:08.740883 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:08.740883 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:01:08.740883 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:01:08.740883 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:01:08.740883 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:01:08.741913 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:08.741913 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:08.741913 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:01:08.741913 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:01:08.741913 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:01:08.741913 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:01:08.741913 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:08.741913 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:08.741913 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:08.741913 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:08.741913 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:08.741913 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:08.741913 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:08.741913 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:08.741913 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:08.741913 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:08.741913 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:08.741913 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:08.742792 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:08.742792 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:08.742792 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:01:08.742792 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:01:08.742792 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:01:08.742792 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:01:08.742792 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:01:08.742792 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:01:08.742792 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 04:01:08.742792 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:08.742792 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 261/505] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 04:01:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:08.742792 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196bec20-909d-4e2e-a839-b60923b6e0c8 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:08.793219 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:08.835394 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32a27a-1030-48d5-a17d-5e3fc57b61af None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:08.848744 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196bec20-909d-4e2e-a839-b60923b6e0c8 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:08.869399 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05cf71-8370-44d0-a763-d92987bf242e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:08.870000 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05cf71-8370-44d0-a763-d92987bf242e None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:08.870276 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05cf71-8370-44d0-a763-d92987bf242e None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:08.870543 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05cf71-8370-44d0-a763-d92987bf242e None admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:08.871179 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b05cf71-8370-44d0-a763-d92987bf242e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:08.871500 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b05cf71-8370-44d0-a763-d92987bf242e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:08.872878 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b05cf71-8370-44d0-a763-d92987bf242e None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:08.884978 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ca04a-5abf-4d92-8c37-46f6c9366462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:08.885259 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 245/506] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 04:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:08.886306 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ca04a-5abf-4d92-8c37-46f6c9366462 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:08.886491 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05cf71-8370-44d0-a763-d92987bf242e None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:08.886659 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ca04a-5abf-4d92-8c37-46f6c9366462 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:08.887175 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ca04a-5abf-4d92-8c37-46f6c9366462 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:08.945788 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:08.959945 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ca04a-5abf-4d92-8c37-46f6c9366462 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:08.961431 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ca04a-5abf-4d92-8c37-46f6c9366462 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:08.995163 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05cf71-8370-44d0-a763-d92987bf242e None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:09.015811 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:09.031237 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a8ccde-e870-4e3d-8339-d8206f90f676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:09.031868 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8ccde-e870-4e3d-8339-d8206f90f676 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:09.032142 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8ccde-e870-4e3d-8339-d8206f90f676 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:09.032411 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8ccde-e870-4e3d-8339-d8206f90f676 None admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:09.033057 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a8ccde-e870-4e3d-8339-d8206f90f676 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:09.033359 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a8ccde-e870-4e3d-8339-d8206f90f676 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:09.034747 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a8ccde-e870-4e3d-8339-d8206f90f676 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:09.047269 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 246/507] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 04:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:09.047857 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a8ccde-e870-4e3d-8339-d8206f90f676 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:09.072591 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 262/508] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 24 04:01:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:09.072591 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ca04a-5abf-4d92-8c37-46f6c9366462 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:09.150741 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a8ccde-e870-4e3d-8339-d8206f90f676 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:09.155888 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:09.171133 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ca04a-5abf-4d92-8c37-46f6c9366462 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:09.184545 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2061c7-1206-4ddc-9ffc-345ba77336d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:09.185141 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2061c7-1206-4ddc-9ffc-345ba77336d6 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:09.185428 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2061c7-1206-4ddc-9ffc-345ba77336d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:09.185700 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2061c7-1206-4ddc-9ffc-345ba77336d6 None admin] PATH_INFO: `/v3/users` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:09.186435 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2061c7-1206-4ddc-9ffc-345ba77336d6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:09.186744 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2061c7-1206-4ddc-9ffc-345ba77336d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:09.188233 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2061c7-1206-4ddc-9ffc-345ba77336d6 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:09.205118 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab9945-ace1-491d-94d3-9917d049d7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:09.205727 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab9945-ace1-491d-94d3-9917d049d7ba None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:09.205992 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab9945-ace1-491d-94d3-9917d049d7ba None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:09.206117 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 247/509] 10.222.0.15 () {56 vars in 1137 bytes} [Wed Aug 24 04:01:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:09.206259 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab9945-ace1-491d-94d3-9917d049d7ba None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:09.206839 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2061c7-1206-4ddc-9ffc-345ba77336d6 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:09.213928 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ab9945-ace1-491d-94d3-9917d049d7ba None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:09.215420 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ab9945-ace1-491d-94d3-9917d049d7ba None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:09.228310 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-17ab9945-ace1-491d-94d3-9917d049d7ba None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 04:01:09.228310 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:09.228310 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:09.228310 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:09.228310 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:09.228310 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:09.228310 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:09.228310 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:09.228310 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:09.228310 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:09.228310 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:09.228310 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:09.228310 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:01:09.228310 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:01:09.228310 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:01:09.228310 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:01:09.229276 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:09.229276 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:09.229276 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:01:09.229276 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:01:09.229276 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:01:09.229276 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:01:09.229276 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:09.229276 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:09.229276 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:09.229276 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:09.229276 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:09.229276 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:09.229276 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:09.229276 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:09.229276 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:09.229276 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:09.229276 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:09.229276 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:09.230173 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:09.230173 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:09.230173 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:01:09.230173 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:01:09.230173 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:01:09.230173 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:01:09.230173 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:01:09.230173 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:01:09.230173 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 04:01:09.230173 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:09.230173 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 263/510] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Aug 24 04:01:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:09.230173 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab9945-ace1-491d-94d3-9917d049d7ba None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:09.250109 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:09.309670 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2061c7-1206-4ddc-9ffc-345ba77336d6 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:09.331917 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab9945-ace1-491d-94d3-9917d049d7ba None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:09.344887 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173abf9d-9624-415b-a799-2f5ed7c0732a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:09.345605 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173abf9d-9624-415b-a799-2f5ed7c0732a None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:09.345789 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173abf9d-9624-415b-a799-2f5ed7c0732a None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:09.346106 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173abf9d-9624-415b-a799-2f5ed7c0732a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:09.352971 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173abf9d-9624-415b-a799-2f5ed7c0732a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:09.354425 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173abf9d-9624-415b-a799-2f5ed7c0732a None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:09.364685 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b0d99-37fc-4423-a518-d752a95fd3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:09.365303 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b0d99-37fc-4423-a518-d752a95fd3da None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:09.365580 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b0d99-37fc-4423-a518-d752a95fd3da None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:09.365880 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b0d99-37fc-4423-a518-d752a95fd3da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:09.366361 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-173abf9d-9624-415b-a799-2f5ed7c0732a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:01:09.366361 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:09.366361 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:09.366361 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:09.366361 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:09.366361 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:09.366361 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:09.366361 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:09.366361 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:09.366361 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:09.366361 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:09.366361 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:09.366361 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:01:09.366361 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:01:09.366361 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:01:09.367422 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:01:09.367422 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:09.367422 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:09.367422 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:09.367422 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:09.367422 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:09.367422 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:09.367422 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:09.367422 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:09.367422 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:09.367422 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:09.367422 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:09.367422 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:09.367422 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:09.367422 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:09.367422 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:09.367422 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:09.368464 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:01:09.368464 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:01:09.368464 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:01:09.368464 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:01:09.368464 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:01:09.368464 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:01:09.368464 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:01:09.368464 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:09.368464 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 248/511] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 24 04:01:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:09.368464 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173abf9d-9624-415b-a799-2f5ed7c0732a None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:09.379983 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b0d99-37fc-4423-a518-d752a95fd3da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:09.381469 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b0d99-37fc-4423-a518-d752a95fd3da None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:09.387974 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:09.396818 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-7c1b0d99-37fc-4423-a518-d752a95fd3da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:09.396818 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:09.396818 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:09.396818 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:09.396818 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:09.396818 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:09.396818 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:09.396818 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:09.396818 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:09.396818 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:09.396818 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:09.396818 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:09.396818 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:01:09.396818 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:01:09.396818 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:01:09.396818 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:01:09.397900 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:09.397900 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:09.397900 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:09.397900 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:09.397900 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:09.397900 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:09.397900 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:09.397900 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:09.397900 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:09.397900 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:09.397900 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:09.397900 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:09.397900 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:09.397900 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:09.397900 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:09.397900 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:09.397900 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:01:09.398952 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:01:09.398952 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:09.398952 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:09.399309 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 264/512] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:01:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:09.400114 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b0d99-37fc-4423-a518-d752a95fd3da None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:09.467017 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:09.470773 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173abf9d-9624-415b-a799-2f5ed7c0732a None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:09.504740 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b0d99-37fc-4423-a518-d752a95fd3da None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:09.506301 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aaad69-e1d2-435b-beb0-68242dca2f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:09.506936 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aaad69-e1d2-435b-beb0-68242dca2f2d None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:09.507219 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aaad69-e1d2-435b-beb0-68242dca2f2d None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:09.507513 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aaad69-e1d2-435b-beb0-68242dca2f2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:09.542050 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5ee3f-9c0c-4616-9ea4-5b0e9bf6cc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:09.542656 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5ee3f-9c0c-4616-9ea4-5b0e9bf6cc93 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:09.542906 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5ee3f-9c0c-4616-9ea4-5b0e9bf6cc93 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:09.543299 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5ee3f-9c0c-4616-9ea4-5b0e9bf6cc93 None admin] PATH_INFO: `/v3/users` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:09.544035 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5ee3f-9c0c-4616-9ea4-5b0e9bf6cc93 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:09.544339 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5ee3f-9c0c-4616-9ea4-5b0e9bf6cc93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:09.545789 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5ee3f-9c0c-4616-9ea4-5b0e9bf6cc93 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:09.564643 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 265/513] 10.222.0.15 () {56 vars in 1139 bytes} [Wed Aug 24 04:01:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:09.565783 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5ee3f-9c0c-4616-9ea4-5b0e9bf6cc93 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:09.581600 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aaad69-e1d2-435b-beb0-68242dca2f2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:09.583105 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aaad69-e1d2-435b-beb0-68242dca2f2d None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:09.628126 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:09.673160 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5ee3f-9c0c-4616-9ea4-5b0e9bf6cc93 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:09.679919 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:09.686405 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 249/514] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 24 04:01:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:09.687702 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aaad69-e1d2-435b-beb0-68242dca2f2d None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:09.713279 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0e4bf-3cc2-4983-9e92-0bad3bb3ccb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:09.713982 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0e4bf-3cc2-4983-9e92-0bad3bb3ccb1 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:09.714250 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0e4bf-3cc2-4983-9e92-0bad3bb3ccb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:09.714527 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0e4bf-3cc2-4983-9e92-0bad3bb3ccb1 None admin] PATH_INFO: `/v3/projects` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:09.715268 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0e4bf-3cc2-4983-9e92-0bad3bb3ccb1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:09.715575 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0e4bf-3cc2-4983-9e92-0bad3bb3ccb1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:09.717030 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0e4bf-3cc2-4983-9e92-0bad3bb3ccb1 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:09.735632 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 266/515] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 24 04:01:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:09.736507 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0e4bf-3cc2-4983-9e92-0bad3bb3ccb1 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:09.793079 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aaad69-e1d2-435b-beb0-68242dca2f2d None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:09.827591 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a73a2f-bb72-46cc-a41d-e5c000006370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:09.828341 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a73a2f-bb72-46cc-a41d-e5c000006370 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:09.828705 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a73a2f-bb72-46cc-a41d-e5c000006370 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:09.829036 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a73a2f-bb72-46cc-a41d-e5c000006370 None admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:09.829688 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a73a2f-bb72-46cc-a41d-e5c000006370 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:09.829988 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a73a2f-bb72-46cc-a41d-e5c000006370 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:09.831391 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a73a2f-bb72-46cc-a41d-e5c000006370 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:09.837146 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0e4bf-3cc2-4983-9e92-0bad3bb3ccb1 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:09.842725 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 250/516] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 04:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:09.843583 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a73a2f-bb72-46cc-a41d-e5c000006370 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:09.857074 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:09.873181 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acffc01-3022-40c6-ba40-2c4c8ca0974e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:09.873840 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acffc01-3022-40c6-ba40-2c4c8ca0974e None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:09.874124 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acffc01-3022-40c6-ba40-2c4c8ca0974e None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:09.874646 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acffc01-3022-40c6-ba40-2c4c8ca0974e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:09.907143 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:09.948498 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acffc01-3022-40c6-ba40-2c4c8ca0974e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:09.949977 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acffc01-3022-40c6-ba40-2c4c8ca0974e None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:09.961400 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a73a2f-bb72-46cc-a41d-e5c000006370 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:09.997332 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d389b-d231-4bd7-b212-3c853744591d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:09.998223 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d389b-d231-4bd7-b212-3c853744591d None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:09.998500 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d389b-d231-4bd7-b212-3c853744591d None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:09.998772 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d389b-d231-4bd7-b212-3c853744591d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:10.010020 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d389b-d231-4bd7-b212-3c853744591d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:10.011828 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d389b-d231-4bd7-b212-3c853744591d None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:10.028981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-783d389b-d231-4bd7-b212-3c853744591d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:10.028981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:10.028981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:10.028981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:10.028981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:10.028981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:10.028981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:10.028981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:10.028981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:10.028981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:10.028981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:10.028981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:10.028981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:01:10.028981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:01:10.028981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:01:10.028981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:01:10.030083 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:10.030083 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:10.030083 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:10.030083 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:10.030083 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:10.030083 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:10.030083 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:10.030083 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:10.030083 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:10.030083 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:10.030083 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:10.030083 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:10.030083 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:10.030083 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:10.030083 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:10.030083 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:10.030083 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:01:10.031157 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:01:10.031157 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:10.031157 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:10.035542 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 251/517] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:01:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:10.036482 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d389b-d231-4bd7-b212-3c853744591d None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:10.057755 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 267/518] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 24 04:01:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:10.063046 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acffc01-3022-40c6-ba40-2c4c8ca0974e None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:10.081136 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:10.140139 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d389b-d231-4bd7-b212-3c853744591d None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:10.150413 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:10.163168 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acffc01-3022-40c6-ba40-2c4c8ca0974e None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:10.174377 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffe6f5-b6b0-420c-8480-cdfc85b90f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:10.174975 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffe6f5-b6b0-420c-8480-cdfc85b90f0f None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:10.175285 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffe6f5-b6b0-420c-8480-cdfc85b90f0f None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:10.175554 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffe6f5-b6b0-420c-8480-cdfc85b90f0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:10.176271 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaffe6f5-b6b0-420c-8480-cdfc85b90f0f None admin] RBAC: Adding query filter params (role.id=4278d3d9834d462b821b63a99db9229a, scope.project.id=5c317b3ce1d1468f95bc01ba2587e623, user.id=3796b1549762419686cb3b00af1a963e) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:10.176572 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaffe6f5-b6b0-420c-8480-cdfc85b90f0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:10.178011 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaffe6f5-b6b0-420c-8480-cdfc85b90f0f None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:10.183485 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 252/519] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 24 04:01:10 2022] GET /identity/v3/role_assignments?user.id=3796b1549762419686cb3b00af1a963e&scope.project.id=5c317b3ce1d1468f95bc01ba2587e623&role.id=4278d3d9834d462b821b63a99db9229a => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:10.195468 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffe6f5-b6b0-420c-8480-cdfc85b90f0f None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:10.204506 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86fa82-d03c-4253-8f2d-9450d0614847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:10.205150 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86fa82-d03c-4253-8f2d-9450d0614847 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:10.205424 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86fa82-d03c-4253-8f2d-9450d0614847 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:10.205694 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86fa82-d03c-4253-8f2d-9450d0614847 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:10.213825 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86fa82-d03c-4253-8f2d-9450d0614847 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:10.215331 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86fa82-d03c-4253-8f2d-9450d0614847 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:10.229687 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-8d86fa82-d03c-4253-8f2d-9450d0614847 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:01:10.229687 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:10.229687 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:10.229687 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:10.229687 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:10.229687 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:10.229687 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:10.229687 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:10.229687 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:10.229687 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:10.229687 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:10.229687 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:10.229687 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:01:10.229687 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:01:10.229687 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:01:10.231651 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:01:10.231651 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:10.231651 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:10.231651 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:10.231651 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:10.231651 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:10.231651 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:10.231651 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:10.231651 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:10.231651 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:10.231651 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:10.231651 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:10.231651 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:10.231651 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:10.231651 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:10.231651 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:10.231651 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:10.232630 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:01:10.232630 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:01:10.232630 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:01:10.232630 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:01:10.232630 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:01:10.232630 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:01:10.232630 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:01:10.232630 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:10.232630 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 268/520] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 24 04:01:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:10.232630 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86fa82-d03c-4253-8f2d-9450d0614847 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:10.319226 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:10.348729 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86fa82-d03c-4253-8f2d-9450d0614847 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:10.360289 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffe6f5-b6b0-420c-8480-cdfc85b90f0f None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:10.389747 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ca3e7-2f0b-451d-b431-ca7028426518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:10.390734 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ca3e7-2f0b-451d-b431-ca7028426518 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:10.391023 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ca3e7-2f0b-451d-b431-ca7028426518 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:10.391335 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ca3e7-2f0b-451d-b431-ca7028426518 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:10.401473 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb40c2-dbaf-4f33-ba9a-7a9c11433cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:10.402447 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb40c2-dbaf-4f33-ba9a-7a9c11433cf5 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:10.402656 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791ca3e7-2f0b-451d-b431-ca7028426518 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:10.402833 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb40c2-dbaf-4f33-ba9a-7a9c11433cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:10.402977 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb40c2-dbaf-4f33-ba9a-7a9c11433cf5 None admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:10.403638 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbb40c2-dbaf-4f33-ba9a-7a9c11433cf5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:10.403940 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbb40c2-dbaf-4f33-ba9a-7a9c11433cf5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:10.404102 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791ca3e7-2f0b-451d-b431-ca7028426518 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:10.405301 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbb40c2-dbaf-4f33-ba9a-7a9c11433cf5 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:10.420134 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 253/521] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 04:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:10.420313 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-791ca3e7-2f0b-451d-b431-ca7028426518 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:10.420313 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:10.420313 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:10.420313 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:10.420313 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:10.420313 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:10.420313 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:10.420313 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:10.420313 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:10.420313 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:10.420313 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:10.420313 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:10.420313 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:01:10.420313 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:01:10.420313 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:01:10.420313 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:01:10.421577 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:10.421577 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:10.421577 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:10.421577 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:10.421577 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:10.421577 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:10.421577 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:10.421577 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:10.421577 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:10.421577 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:10.421577 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:10.421577 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:10.421577 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:10.421577 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:10.421577 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:10.421577 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:10.421577 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:01:10.422619 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:01:10.422619 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:10.422619 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:10.422798 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb40c2-dbaf-4f33-ba9a-7a9c11433cf5 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:10.422866 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 269/522] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:01:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:10.426443 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ca3e7-2f0b-451d-b431-ca7028426518 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:10.460913 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:10.539983 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ca3e7-2f0b-451d-b431-ca7028426518 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:10.542233 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb40c2-dbaf-4f33-ba9a-7a9c11433cf5 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:10.568436 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:10.577581 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab4e9d3-b2da-4098-937a-81db9bbc6646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:10.578197 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab4e9d3-b2da-4098-937a-81db9bbc6646 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:10.578542 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab4e9d3-b2da-4098-937a-81db9bbc6646 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:10.578747 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab4e9d3-b2da-4098-937a-81db9bbc6646 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:10.581012 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476a43f-f1b0-4370-b271-afd1bf15a391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:10.581674 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476a43f-f1b0-4370-b271-afd1bf15a391 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:10.581894 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476a43f-f1b0-4370-b271-afd1bf15a391 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:10.582151 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476a43f-f1b0-4370-b271-afd1bf15a391 None admin] PATH_INFO: `/v3/projects` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:10.582840 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476a43f-f1b0-4370-b271-afd1bf15a391 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:10.583141 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476a43f-f1b0-4370-b271-afd1bf15a391 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:10.584621 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476a43f-f1b0-4370-b271-afd1bf15a391 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:10.586390 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab4e9d3-b2da-4098-937a-81db9bbc6646 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:10.587876 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab4e9d3-b2da-4098-937a-81db9bbc6646 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:10.599549 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-1ab4e9d3-b2da-4098-937a-81db9bbc6646 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:01:10.599549 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:10.599549 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:10.599549 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:10.599549 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:10.599549 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:10.599549 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:10.599549 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:10.599549 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:10.599549 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:10.599549 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:10.599549 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:10.599549 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:01:10.599549 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:01:10.599549 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:01:10.600402 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:01:10.600402 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:10.600402 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:10.600402 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:10.600402 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:10.600402 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:10.600402 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:10.600402 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:10.600402 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:10.600402 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:10.600402 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:10.600402 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:10.600402 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:10.600402 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:10.600402 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:10.600402 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:10.600402 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:10.601447 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:01:10.601447 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:01:10.601447 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:01:10.601447 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:01:10.601447 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:01:10.601447 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:01:10.601447 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:01:10.601447 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:10.601447 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 270/523] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 24 04:01:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:10.601925 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab4e9d3-b2da-4098-937a-81db9bbc6646 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:10.613949 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 254/524] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 24 04:01:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:10.613949 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476a43f-f1b0-4370-b271-afd1bf15a391 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:10.714515 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab4e9d3-b2da-4098-937a-81db9bbc6646 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:10.718432 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476a43f-f1b0-4370-b271-afd1bf15a391 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:10.720016 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:10.751089 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89eaef8-658c-4640-bfd5-bca2f71c57fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:10.751723 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89eaef8-658c-4640-bfd5-bca2f71c57fb None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:10.752027 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89eaef8-658c-4640-bfd5-bca2f71c57fb None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:10.752261 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89eaef8-658c-4640-bfd5-bca2f71c57fb None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:10.752918 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89eaef8-658c-4640-bfd5-bca2f71c57fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:10.753220 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89eaef8-658c-4640-bfd5-bca2f71c57fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:10.754607 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89eaef8-658c-4640-bfd5-bca2f71c57fb None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:10.755559 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b104625d-c169-4b4d-8f1f-77a6618740c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:10.756164 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104625d-c169-4b4d-8f1f-77a6618740c4 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:10.756435 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104625d-c169-4b4d-8f1f-77a6618740c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:10.756767 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104625d-c169-4b4d-8f1f-77a6618740c4 None admin] PATH_INFO: `/v3/projects` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:10.757462 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b104625d-c169-4b4d-8f1f-77a6618740c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:10.757760 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b104625d-c169-4b4d-8f1f-77a6618740c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:10.759259 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b104625d-c169-4b4d-8f1f-77a6618740c4 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:10.768855 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 271/525] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 04:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:10.770050 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89eaef8-658c-4640-bfd5-bca2f71c57fb None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:10.776725 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 255/526] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 24 04:01:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:10.777570 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b104625d-c169-4b4d-8f1f-77a6618740c4 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:10.832541 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:10.887723 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89eaef8-658c-4640-bfd5-bca2f71c57fb None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:10.887901 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b104625d-c169-4b4d-8f1f-77a6618740c4 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:10.931926 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd922a2-fc00-481d-9da2-3219957feedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:10.932698 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd922a2-fc00-481d-9da2-3219957feedf None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:10.932979 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd922a2-fc00-481d-9da2-3219957feedf None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:10.933604 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd922a2-fc00-481d-9da2-3219957feedf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:10.934611 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd922a2-fc00-481d-9da2-3219957feedf None admin] RBAC: Adding query filter params (role.id=4278d3d9834d462b821b63a99db9229a, scope.project.id=5c317b3ce1d1468f95bc01ba2587e623, user.id=7da73e8a2c7a4c5aafd1d3fbea603970) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:10.934957 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd922a2-fc00-481d-9da2-3219957feedf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:10.936469 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd922a2-fc00-481d-9da2-3219957feedf None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:10.938593 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79723d-4cda-49f3-ab76-c9923faaf18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:10.939249 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79723d-4cda-49f3-ab76-c9923faaf18e None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:10.939531 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79723d-4cda-49f3-ab76-c9923faaf18e None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:10.939807 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79723d-4cda-49f3-ab76-c9923faaf18e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:10.943484 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 272/527] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 24 04:01:10 2022] GET /identity/v3/role_assignments?user.id=7da73e8a2c7a4c5aafd1d3fbea603970&scope.project.id=5c317b3ce1d1468f95bc01ba2587e623&role.id=4278d3d9834d462b821b63a99db9229a => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:10.944869 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd922a2-fc00-481d-9da2-3219957feedf None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:10.947645 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79723d-4cda-49f3-ab76-c9923faaf18e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:10.949269 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79723d-4cda-49f3-ab76-c9923faaf18e None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:10.965921 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-3c79723d-4cda-49f3-ab76-c9923faaf18e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:01:10.965921 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:10.965921 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:10.965921 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:10.965921 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:10.965921 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:10.965921 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:10.965921 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:10.965921 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:10.965921 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:10.965921 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:10.965921 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:10.965921 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:01:10.965921 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:01:10.965921 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:01:10.966836 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:01:10.966836 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:10.966836 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:10.966836 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:10.966836 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:10.966836 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:10.966836 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:10.966836 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:10.966836 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:10.966836 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:10.966836 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:10.966836 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:10.966836 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:10.966836 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:10.966836 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:10.966836 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:10.966836 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:10.967750 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:01:10.967750 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:01:10.967750 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:01:10.967750 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:01:10.967750 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:01:10.967750 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:01:10.967750 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:01:10.967750 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:10.971367 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 256/528] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 24 04:01:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:10.974083 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79723d-4cda-49f3-ab76-c9923faaf18e None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:10.997549 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:11.093139 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd922a2-fc00-481d-9da2-3219957feedf None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:11.110685 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:11.123230 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79723d-4cda-49f3-ab76-c9923faaf18e None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:11.142237 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d6f71-434a-48b5-b720-d3a9db68b122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:11.142909 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d6f71-434a-48b5-b720-d3a9db68b122 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:11.143220 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d6f71-434a-48b5-b720-d3a9db68b122 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:11.143502 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d6f71-434a-48b5-b720-d3a9db68b122 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:11.144277 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d6f71-434a-48b5-b720-d3a9db68b122 None admin] RBAC: Adding query filter params (role.id=4278d3d9834d462b821b63a99db9229a, scope.project.id=5c317b3ce1d1468f95bc01ba2587e623, user.id=9d60ca48fd1b4a4ab4261ad1dbd6c8bc) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:11.144587 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d6f71-434a-48b5-b720-d3a9db68b122 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:11.146390 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d6f71-434a-48b5-b720-d3a9db68b122 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:11.157855 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 273/529] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 24 04:01:10 2022] GET /identity/v3/role_assignments?user.id=9d60ca48fd1b4a4ab4261ad1dbd6c8bc&scope.project.id=5c317b3ce1d1468f95bc01ba2587e623&role.id=4278d3d9834d462b821b63a99db9229a => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:11.182601 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b874034-87c8-41bd-9224-91ae2ac575cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:11.183717 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b874034-87c8-41bd-9224-91ae2ac575cf None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:11.184408 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b874034-87c8-41bd-9224-91ae2ac575cf None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:11.184891 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b874034-87c8-41bd-9224-91ae2ac575cf None admin] PATH_INFO: `/v3/projects` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:11.185878 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b874034-87c8-41bd-9224-91ae2ac575cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:11.186399 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b874034-87c8-41bd-9224-91ae2ac575cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:11.188257 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b874034-87c8-41bd-9224-91ae2ac575cf None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:11.210022 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 257/530] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 24 04:01:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:11.212010 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d6f71-434a-48b5-b720-d3a9db68b122 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:11.339517 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d6f71-434a-48b5-b720-d3a9db68b122 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:11.379029 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37102f44-feac-450d-99dc-c710f55937f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:11.379684 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37102f44-feac-450d-99dc-c710f55937f7 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:11.379969 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37102f44-feac-450d-99dc-c710f55937f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:11.380255 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37102f44-feac-450d-99dc-c710f55937f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:11.381002 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37102f44-feac-450d-99dc-c710f55937f7 None admin] RBAC: Adding query filter params (role.id=4278d3d9834d462b821b63a99db9229a, scope.project.id=5c317b3ce1d1468f95bc01ba2587e623, user.id=e62f90d6440048e58cf530701a979e87) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:11.381315 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37102f44-feac-450d-99dc-c710f55937f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:11.382907 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37102f44-feac-450d-99dc-c710f55937f7 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:11.390534 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 274/531] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 24 04:01:11 2022] GET /identity/v3/role_assignments?user.id=e62f90d6440048e58cf530701a979e87&scope.project.id=5c317b3ce1d1468f95bc01ba2587e623&role.id=4278d3d9834d462b821b63a99db9229a => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:12.753423 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5340b-fee2-4bb2-9158-a2589a211930 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:12.754351 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5340b-fee2-4bb2-9158-a2589a211930 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:12.754351 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5340b-fee2-4bb2-9158-a2589a211930 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:12.755744 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 258/532] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:01:12.761438 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a213e8-a719-495f-acc1-4025ec2f3af3 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:12.762130 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a213e8-a719-495f-acc1-4025ec2f3af3 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:12.762235 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a213e8-a719-495f-acc1-4025ec2f3af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:12.780921 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-19a213e8-a719-495f-acc1-4025ec2f3af3 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:01:12.782126 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-19a213e8-a719-495f-acc1-4025ec2f3af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:12.817965 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:12.853366 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 275/533] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:01:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:01:13.229549 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a5340b-fee2-4bb2-9158-a2589a211930 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:13.348391 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:13.378912 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a5340b-fee2-4bb2-9158-a2589a211930 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:13.416785 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c54610-1421-40c6-b05c-51dab8c4ab0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:13.417430 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c54610-1421-40c6-b05c-51dab8c4ab0d None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:13.417707 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c54610-1421-40c6-b05c-51dab8c4ab0d None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:13.417980 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c54610-1421-40c6-b05c-51dab8c4ab0d None admin] PATH_INFO: `/v3/roles/service` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:13.431911 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c54610-1421-40c6-b05c-51dab8c4ab0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:01:13.437097 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-f7c54610-1421-40c6-b05c-51dab8c4ab0d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:01:13.437097 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:13.437097 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:13.437097 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:13.437097 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:13.437097 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:13.437097 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:13.437097 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:13.437097 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:13.437097 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:13.437097 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:13.437097 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:13.437097 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:01:13.437097 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:01:13.437097 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:01:13.437097 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:01:13.438092 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:01:13.438092 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:01:13.438092 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:01:13.438092 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:01:13.438092 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:13.438092 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:13.438092 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:13.438092 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:13.438092 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:13.438092 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:13.438092 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:13.438092 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:13.438092 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:13.438092 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:13.438092 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:13.438092 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:13.438981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:13.438981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:13.438981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:13.438981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:13.438981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:01:13.438981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:01:13.438981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:01:13.438981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:01:13.438981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:01:13.438981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:01:13.438981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:01:13.438981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:13.439679 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5877ad-5596-4085-82d4-12cbafa6598c None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:13.439679 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5877ad-5596-4085-82d4-12cbafa6598c None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:13.439679 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5877ad-5596-4085-82d4-12cbafa6598c None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:13.439888 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 259/534] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Aug 24 04:01:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:13.439960 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 276/535] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:01:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:01:13.447144 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5877ad-5596-4085-82d4-12cbafa6598c None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:13.447720 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475af70-2b06-468f-8dbc-5990bdbb30f1 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:13.448193 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475af70-2b06-468f-8dbc-5990bdbb30f1 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:13.448631 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475af70-2b06-468f-8dbc-5990bdbb30f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:13.471313 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-7475af70-2b06-468f-8dbc-5990bdbb30f1 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:01:13.472535 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-7475af70-2b06-468f-8dbc-5990bdbb30f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:13.555299 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 260/536] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:01:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:01:13.613873 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5877ad-5596-4085-82d4-12cbafa6598c None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:13.616765 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf48233-b91f-45f8-9e0a-6440b9bb77c5 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:13.617044 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf48233-b91f-45f8-9e0a-6440b9bb77c5 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:13.617313 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf48233-b91f-45f8-9e0a-6440b9bb77c5 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:13.619101 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 261/537] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:01:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:01:13.624746 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdce4e3-1286-40c1-9e39-63a6476b2670 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:13.625745 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdce4e3-1286-40c1-9e39-63a6476b2670 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:13.626135 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdce4e3-1286-40c1-9e39-63a6476b2670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:13.648436 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-6fdce4e3-1286-40c1-9e39-63a6476b2670 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:01:13.650057 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-6fdce4e3-1286-40c1-9e39-63a6476b2670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:13.667423 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff03cd9a-d5df-44d2-a2b7-f078deabb09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:13.668088 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03cd9a-d5df-44d2-a2b7-f078deabb09d None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:13.668432 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03cd9a-d5df-44d2-a2b7-f078deabb09d None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:13.668702 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03cd9a-d5df-44d2-a2b7-f078deabb09d None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:13.669420 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff03cd9a-d5df-44d2-a2b7-f078deabb09d None admin] RBAC: Adding query filter params (name=service) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:13.669718 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff03cd9a-d5df-44d2-a2b7-f078deabb09d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:13.671177 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff03cd9a-d5df-44d2-a2b7-f078deabb09d None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:13.681147 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 277/538] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Aug 24 04:01:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:13.688164 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff03cd9a-d5df-44d2-a2b7-f078deabb09d None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:13.726500 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:13.727273 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:13.736707 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 262/539] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:01:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:01:13.775489 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae86642-38e5-4391-8df4-df0627d62266 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:13.776136 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae86642-38e5-4391-8df4-df0627d62266 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:13.776136 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae86642-38e5-4391-8df4-df0627d62266 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:13.778036 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 263/540] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:01:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:01:13.783504 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ecc6b2-3117-471a-bcb6-66b91b22c675 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:13.784084 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ecc6b2-3117-471a-bcb6-66b91b22c675 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:13.784572 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ecc6b2-3117-471a-bcb6-66b91b22c675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:13.803683 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff03cd9a-d5df-44d2-a2b7-f078deabb09d None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:13.807629 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-29ecc6b2-3117-471a-bcb6-66b91b22c675 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:01:13.809156 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-29ecc6b2-3117-471a-bcb6-66b91b22c675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:13.843256 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ee0f9-e458-4689-9195-9de9cb8b52c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:13.844285 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ee0f9-e458-4689-9195-9de9cb8b52c5 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:13.844773 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ee0f9-e458-4689-9195-9de9cb8b52c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:13.845239 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ee0f9-e458-4689-9195-9de9cb8b52c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:13.857330 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ee0f9-e458-4689-9195-9de9cb8b52c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:13.859319 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ee0f9-e458-4689-9195-9de9cb8b52c5 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:13.883144 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-f49ee0f9-e458-4689-9195-9de9cb8b52c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:13.883144 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:13.883144 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:13.883144 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:13.883144 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:13.883144 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:13.883144 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:13.883144 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:13.883144 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:13.883144 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:13.883144 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:13.883144 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:13.883144 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:01:13.883144 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:01:13.883144 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:01:13.883144 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:01:13.884166 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:13.884166 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:13.884166 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:13.884166 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:13.884166 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:13.884166 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:13.884166 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:13.884166 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:13.884166 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:13.884166 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:13.884166 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:13.884166 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:13.884166 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:13.884166 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:13.884166 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:13.884166 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:13.884166 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:01:13.885023 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:01:13.885023 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:13.885023 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:13.887449 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 278/541] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:01:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:13.897658 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ee0f9-e458-4689-9195-9de9cb8b52c5 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:13.898472 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 264/542] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:01:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:01:13.913915 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ecc6b2-3117-471a-bcb6-66b91b22c675 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:14.010950 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:14.035372 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ee0f9-e458-4689-9195-9de9cb8b52c5 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:14.039479 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ecc6b2-3117-471a-bcb6-66b91b22c675 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:14.069432 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:14.081190 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec84cb6e-ac5b-40bc-96dd-ca3b70290b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:14.081805 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34059e8e-90c3-4507-bae9-381f19e8da3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:14.081999 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84cb6e-ac5b-40bc-96dd-ca3b70290b81 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:14.082150 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84cb6e-ac5b-40bc-96dd-ca3b70290b81 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:14.082352 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84cb6e-ac5b-40bc-96dd-ca3b70290b81 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:14.082502 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34059e8e-90c3-4507-bae9-381f19e8da3e None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:14.082808 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34059e8e-90c3-4507-bae9-381f19e8da3e None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:14.083104 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34059e8e-90c3-4507-bae9-381f19e8da3e None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:14.083791 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34059e8e-90c3-4507-bae9-381f19e8da3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:14.084094 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34059e8e-90c3-4507-bae9-381f19e8da3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:14.085528 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34059e8e-90c3-4507-bae9-381f19e8da3e None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:14.095839 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec84cb6e-ac5b-40bc-96dd-ca3b70290b81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:01:14.098439 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 279/543] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 04:01:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:14.099326 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34059e8e-90c3-4507-bae9-381f19e8da3e None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:14.101291 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-ec84cb6e-ac5b-40bc-96dd-ca3b70290b81 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:01:14.101291 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:14.101291 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:14.101291 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:14.101291 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:14.101291 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:14.101291 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:14.101291 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:14.101291 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:14.101291 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:14.101291 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:14.101291 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:14.101291 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:01:14.101291 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:01:14.101291 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:01:14.101291 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:01:14.102177 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:01:14.102177 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:01:14.102177 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:01:14.102177 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:01:14.102177 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:14.102177 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:14.102177 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:14.102177 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:14.102177 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:14.102177 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:14.102177 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:14.102177 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:14.102177 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:14.102177 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:14.102177 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:14.102177 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:14.103049 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:14.103049 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:14.103049 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:14.103049 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:14.103049 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:01:14.103049 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:01:14.103049 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:01:14.103049 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:01:14.103049 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:01:14.103049 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:01:14.103049 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:01:14.103049 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:14.103049 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 265/544] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Aug 24 04:01:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:14.104892 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec84cb6e-ac5b-40bc-96dd-ca3b70290b81 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:14.221444 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34059e8e-90c3-4507-bae9-381f19e8da3e None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:14.233935 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec84cb6e-ac5b-40bc-96dd-ca3b70290b81 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:14.258998 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e4e85e-b6cf-42be-ac0e-1555f53c4261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:14.259665 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4e85e-b6cf-42be-ac0e-1555f53c4261 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:14.259947 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4e85e-b6cf-42be-ac0e-1555f53c4261 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:14.260241 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4e85e-b6cf-42be-ac0e-1555f53c4261 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:14.272790 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374fe04-0234-4f48-9a1a-50536a36d5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:14.273620 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e4e85e-b6cf-42be-ac0e-1555f53c4261 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:01:14.273717 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374fe04-0234-4f48-9a1a-50536a36d5d1 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:14.273794 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374fe04-0234-4f48-9a1a-50536a36d5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:14.274053 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374fe04-0234-4f48-9a1a-50536a36d5d1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:14.277833 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-b4e4e85e-b6cf-42be-ac0e-1555f53c4261 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:01:14.277833 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:14.277833 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:14.277833 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:14.277833 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:14.277833 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:14.277833 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:14.277833 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:14.277833 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:14.277833 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:14.277833 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:14.277833 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:14.277833 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:01:14.277833 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:01:14.277833 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:01:14.277833 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:01:14.278907 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:01:14.278907 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:01:14.278907 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:01:14.278907 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:01:14.278907 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:14.278907 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:14.278907 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:14.278907 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:14.278907 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:14.278907 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:14.278907 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:14.278907 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:14.278907 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:14.278907 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:14.278907 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:14.278907 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:14.280036 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:14.280036 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:14.280036 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:14.280036 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:14.280036 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:01:14.280036 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:01:14.280036 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:01:14.280036 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:01:14.280036 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:01:14.280036 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:01:14.280036 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:01:14.280036 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:14.282132 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5374fe04-0234-4f48-9a1a-50536a36d5d1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:14.283620 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5374fe04-0234-4f48-9a1a-50536a36d5d1 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:14.284854 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 280/545] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Aug 24 04:01:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:14.284854 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e4e85e-b6cf-42be-ac0e-1555f53c4261 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:14.289152 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:14.295904 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-5374fe04-0234-4f48-9a1a-50536a36d5d1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:01:14.295904 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:14.295904 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:14.295904 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:14.295904 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:14.295904 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:14.295904 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:14.295904 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:14.295904 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:14.295904 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:14.295904 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:14.295904 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:14.295904 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:01:14.295904 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:01:14.295904 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:01:14.295904 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:01:14.297010 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:14.297010 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:14.297010 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:01:14.297010 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:01:14.297010 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:01:14.297010 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:01:14.297010 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:14.297010 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:14.297010 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:14.297010 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:14.297010 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:14.297010 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:14.297010 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:14.297010 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:14.297010 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:14.297010 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:14.297010 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:14.297010 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:14.303031 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:14.303031 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:14.303031 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:01:14.303031 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:01:14.303031 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:01:14.303031 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:01:14.303031 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:01:14.303031 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:01:14.303031 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:01:14.303031 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:14.303031 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 266/546] 10.222.0.15 () {56 vars in 1093 bytes} [Wed Aug 24 04:01:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:01:14.303031 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374fe04-0234-4f48-9a1a-50536a36d5d1 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:14.349773 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:14.403085 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e4e85e-b6cf-42be-ac0e-1555f53c4261 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:14.409709 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374fe04-0234-4f48-9a1a-50536a36d5d1 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:14.440725 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10eae3-cc38-4b5b-8f6b-289c7bfad6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:14.441635 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10eae3-cc38-4b5b-8f6b-289c7bfad6aa None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:14.441934 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10eae3-cc38-4b5b-8f6b-289c7bfad6aa None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:14.442204 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10eae3-cc38-4b5b-8f6b-289c7bfad6aa None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:14.442864 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b10eae3-cc38-4b5b-8f6b-289c7bfad6aa None admin] RBAC: Adding query filter params (name=service) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:14.443146 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b10eae3-cc38-4b5b-8f6b-289c7bfad6aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:14.444926 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b10eae3-cc38-4b5b-8f6b-289c7bfad6aa None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:14.445764 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7807b19-a724-48ad-8669-523233aefae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:14.446403 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7807b19-a724-48ad-8669-523233aefae5 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:14.446676 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7807b19-a724-48ad-8669-523233aefae5 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:14.446945 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7807b19-a724-48ad-8669-523233aefae5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:14.459373 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 281/547] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Aug 24 04:01:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:14.459373 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10eae3-cc38-4b5b-8f6b-289c7bfad6aa None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:14.466042 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7807b19-a724-48ad-8669-523233aefae5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:01:14.471335 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-a7807b19-a724-48ad-8669-523233aefae5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:01:14.471335 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:14.471335 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:14.471335 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:14.471335 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:14.471335 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:14.471335 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:14.471335 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:14.471335 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:14.471335 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:14.471335 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:14.471335 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:14.471335 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:01:14.471335 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:01:14.471335 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:01:14.471335 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:01:14.472247 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:01:14.472247 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:01:14.472247 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:01:14.472247 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:01:14.472247 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:14.472247 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:14.472247 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:14.472247 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:14.472247 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:14.472247 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:14.472247 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:14.472247 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:14.472247 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:14.472247 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:14.472247 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:14.472247 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:14.473058 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:14.473058 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:14.473058 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:14.473058 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:14.473058 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:01:14.473058 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:01:14.473058 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:01:14.473058 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:01:14.473058 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:01:14.473058 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:01:14.473058 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:01:14.473058 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:14.473058 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 267/548] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Aug 24 04:01:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:14.473797 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7807b19-a724-48ad-8669-523233aefae5 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:14.530132 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:14.566004 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10eae3-cc38-4b5b-8f6b-289c7bfad6aa None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:14.587649 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7807b19-a724-48ad-8669-523233aefae5 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:14.590169 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:14.601547 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a466eb-bb2a-45bf-b650-3238d75ace97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:14.602067 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a466eb-bb2a-45bf-b650-3238d75ace97 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:14.602338 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a466eb-bb2a-45bf-b650-3238d75ace97 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:14.602611 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a466eb-bb2a-45bf-b650-3238d75ace97 None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:14.603276 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a466eb-bb2a-45bf-b650-3238d75ace97 None admin] RBAC: Adding query filter params (name=service) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:14.603670 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a466eb-bb2a-45bf-b650-3238d75ace97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:14.605275 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a466eb-bb2a-45bf-b650-3238d75ace97 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:14.613495 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 282/549] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Aug 24 04:01:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:14.614291 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a466eb-bb2a-45bf-b650-3238d75ace97 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:14.625769 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da417203-61dd-48bf-ac2b-2aa8d183cf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:14.626376 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da417203-61dd-48bf-ac2b-2aa8d183cf0d None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:14.626654 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da417203-61dd-48bf-ac2b-2aa8d183cf0d None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:14.626922 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da417203-61dd-48bf-ac2b-2aa8d183cf0d None admin] PATH_INFO: `/v3/users` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:14.627709 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da417203-61dd-48bf-ac2b-2aa8d183cf0d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:14.628140 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da417203-61dd-48bf-ac2b-2aa8d183cf0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:14.629458 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da417203-61dd-48bf-ac2b-2aa8d183cf0d None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:14.646913 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 268/550] 10.222.0.15 () {56 vars in 1133 bytes} [Wed Aug 24 04:01:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:14.652194 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da417203-61dd-48bf-ac2b-2aa8d183cf0d None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:14.715649 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a466eb-bb2a-45bf-b650-3238d75ace97 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:14.742824 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:14.752293 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a4b25-5e40-40c0-b6e8-f327c77f4a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:14.753019 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a4b25-5e40-40c0-b6e8-f327c77f4a29 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:14.753368 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a4b25-5e40-40c0-b6e8-f327c77f4a29 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:14.753461 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da417203-61dd-48bf-ac2b-2aa8d183cf0d None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:14.753762 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a4b25-5e40-40c0-b6e8-f327c77f4a29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:14.765857 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a4b25-5e40-40c0-b6e8-f327c77f4a29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:14.767360 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a4b25-5e40-40c0-b6e8-f327c77f4a29 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:14.782321 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-aa1a4b25-5e40-40c0-b6e8-f327c77f4a29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:14.782321 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:14.782321 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:14.782321 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:14.782321 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:14.782321 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:14.782321 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:14.782321 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:14.782321 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:14.782321 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:14.782321 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:14.782321 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:14.782321 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:01:14.782321 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:01:14.782321 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:01:14.782321 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:01:14.783306 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:14.783306 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:14.783306 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:14.783306 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:14.783306 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:14.783306 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:14.783306 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:14.783306 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:14.783306 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:14.783306 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:14.783306 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:14.783306 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:14.783306 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:14.783306 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:14.783306 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:14.783306 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:14.783306 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:01:14.784732 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:01:14.784732 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:14.784732 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:14.784732 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 283/551] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:01:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:14.784732 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a4b25-5e40-40c0-b6e8-f327c77f4a29 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:14.794296 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3cf5b-c616-4f3d-8ac2-a2c52125de52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:14.794935 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3cf5b-c616-4f3d-8ac2-a2c52125de52 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:14.795229 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3cf5b-c616-4f3d-8ac2-a2c52125de52 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:14.795505 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3cf5b-c616-4f3d-8ac2-a2c52125de52 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:14.796173 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae3cf5b-c616-4f3d-8ac2-a2c52125de52 None admin] RBAC: Adding query filter params (name=service) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:14.796461 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae3cf5b-c616-4f3d-8ac2-a2c52125de52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:14.797864 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae3cf5b-c616-4f3d-8ac2-a2c52125de52 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:14.806404 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 269/552] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Aug 24 04:01:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:14.807273 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3cf5b-c616-4f3d-8ac2-a2c52125de52 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:14.835042 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:14.888039 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a4b25-5e40-40c0-b6e8-f327c77f4a29 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:14.915364 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3cf5b-c616-4f3d-8ac2-a2c52125de52 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:14.921587 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e79f2-19ea-44d2-8102-324943f11cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:14.922280 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e79f2-19ea-44d2-8102-324943f11cd3 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:14.922555 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e79f2-19ea-44d2-8102-324943f11cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:14.922821 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e79f2-19ea-44d2-8102-324943f11cd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:14.935320 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e79f2-19ea-44d2-8102-324943f11cd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:14.937023 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e79f2-19ea-44d2-8102-324943f11cd3 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:14.952162 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-341e79f2-19ea-44d2-8102-324943f11cd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:14.952162 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:14.952162 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:14.952162 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:14.952162 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:14.952162 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:14.952162 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:14.952162 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:14.952162 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:14.952162 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:14.952162 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:14.952162 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:14.952162 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:01:14.952162 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:01:14.952162 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:01:14.952162 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:01:14.953350 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:14.953350 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:14.953350 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:14.953350 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:14.953350 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:14.953350 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:14.953350 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:14.953350 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:14.953350 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:14.953350 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:14.953350 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:14.953350 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:14.953350 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:14.953350 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:14.953350 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:14.953350 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:14.953350 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:01:14.954227 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:01:14.954227 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:14.954227 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:14.954227 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 284/553] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:01:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:14.954227 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e79f2-19ea-44d2-8102-324943f11cd3 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:14.956258 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ce98a-9348-44de-b122-a5fc61e2a76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:14.957091 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ce98a-9348-44de-b122-a5fc61e2a76b None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:14.957370 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ce98a-9348-44de-b122-a5fc61e2a76b None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:14.958558 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ce98a-9348-44de-b122-a5fc61e2a76b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:14.969709 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ce98a-9348-44de-b122-a5fc61e2a76b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:14.971211 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ce98a-9348-44de-b122-a5fc61e2a76b None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:14.985146 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:14.985366 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-be8ce98a-9348-44de-b122-a5fc61e2a76b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:14.985366 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:14.985366 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:14.985366 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:14.985366 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:14.985366 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:14.985366 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:14.985366 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:14.985366 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:14.985366 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:14.985366 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:14.985366 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:14.985366 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:01:14.985366 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:01:14.985366 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:01:14.985366 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:01:14.986485 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:14.986485 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:14.986485 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:14.986485 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:14.986485 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:14.986485 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:14.986485 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:14.986485 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:14.986485 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:14.986485 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:14.986485 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:14.986485 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:14.986485 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:14.986485 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:14.986485 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:14.986485 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:14.986485 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:01:14.987418 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:01:14.987418 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:14.987418 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:14.987418 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 270/554] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:01:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:14.987418 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ce98a-9348-44de-b122-a5fc61e2a76b None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:15.056864 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e79f2-19ea-44d2-8102-324943f11cd3 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:15.070330 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:15.095878 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ce98a-9348-44de-b122-a5fc61e2a76b None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:15.100807 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9eee9c-1b03-455f-9072-e1e87043c0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:15.101408 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9eee9c-1b03-455f-9072-e1e87043c0d8 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:15.101686 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9eee9c-1b03-455f-9072-e1e87043c0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:15.101951 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9eee9c-1b03-455f-9072-e1e87043c0d8 None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:15.102593 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9eee9c-1b03-455f-9072-e1e87043c0d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:15.102880 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9eee9c-1b03-455f-9072-e1e87043c0d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:15.104279 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9eee9c-1b03-455f-9072-e1e87043c0d8 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:15.116444 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 285/555] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 04:01:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:15.117779 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9eee9c-1b03-455f-9072-e1e87043c0d8 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:15.131795 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56aa71a-6e7a-4d84-b09b-3693ac53a893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:15.132440 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56aa71a-6e7a-4d84-b09b-3693ac53a893 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:15.132712 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56aa71a-6e7a-4d84-b09b-3693ac53a893 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:15.132978 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56aa71a-6e7a-4d84-b09b-3693ac53a893 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:15.145709 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56aa71a-6e7a-4d84-b09b-3693ac53a893 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:15.147138 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56aa71a-6e7a-4d84-b09b-3693ac53a893 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:15.162424 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-d56aa71a-6e7a-4d84-b09b-3693ac53a893 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:15.162424 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:15.162424 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:15.162424 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:15.162424 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:15.162424 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:15.162424 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:15.162424 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:15.162424 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:15.162424 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:15.162424 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:15.162424 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:15.162424 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:01:15.162424 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:01:15.162424 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:01:15.162424 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:01:15.163511 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:15.163511 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:15.163511 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:15.163511 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:15.163511 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:15.163511 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:15.163511 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:15.163511 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:15.163511 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:15.163511 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:15.163511 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:15.163511 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:15.163511 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:15.163511 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:15.163511 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:15.163511 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:15.163511 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:01:15.164387 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:01:15.164387 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:15.164387 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:15.164387 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 271/556] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:01:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:15.164387 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56aa71a-6e7a-4d84-b09b-3693ac53a893 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:15.218896 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:15.228288 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9eee9c-1b03-455f-9072-e1e87043c0d8 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:15.263540 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d448edb-718a-4179-9a41-81d9af8b300d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:15.264150 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d448edb-718a-4179-9a41-81d9af8b300d None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:15.264429 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d448edb-718a-4179-9a41-81d9af8b300d None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:15.264698 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d448edb-718a-4179-9a41-81d9af8b300d None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:15.265338 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d448edb-718a-4179-9a41-81d9af8b300d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:15.265642 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d448edb-718a-4179-9a41-81d9af8b300d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:15.266812 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56aa71a-6e7a-4d84-b09b-3693ac53a893 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:15.267016 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d448edb-718a-4179-9a41-81d9af8b300d None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:15.278774 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 286/557] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 04:01:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:15.279635 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d448edb-718a-4179-9a41-81d9af8b300d None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:15.293910 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:15.302387 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7273393-2d6f-46c3-b7f4-293c4c623297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:15.302993 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7273393-2d6f-46c3-b7f4-293c4c623297 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:15.303294 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7273393-2d6f-46c3-b7f4-293c4c623297 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:15.303600 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7273393-2d6f-46c3-b7f4-293c4c623297 None admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:15.304239 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7273393-2d6f-46c3-b7f4-293c4c623297 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:15.304532 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7273393-2d6f-46c3-b7f4-293c4c623297 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:15.305929 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7273393-2d6f-46c3-b7f4-293c4c623297 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:15.317834 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 272/558] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 04:01:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:15.318627 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7273393-2d6f-46c3-b7f4-293c4c623297 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:15.384941 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d448edb-718a-4179-9a41-81d9af8b300d None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:15.420931 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7273393-2d6f-46c3-b7f4-293c4c623297 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:15.432264 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08a139-f701-4113-938e-902d60e7582d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:15.432899 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08a139-f701-4113-938e-902d60e7582d None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:15.433180 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08a139-f701-4113-938e-902d60e7582d None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:15.433451 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08a139-f701-4113-938e-902d60e7582d None admin] PATH_INFO: `/v3/users/glance` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:15.441278 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08a139-f701-4113-938e-902d60e7582d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:15.442698 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08a139-f701-4113-938e-902d60e7582d None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:15.454124 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-fb08a139-f701-4113-938e-902d60e7582d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 04:01:15.454124 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:15.454124 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:15.454124 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:15.454124 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:15.454124 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:15.454124 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:15.454124 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:15.454124 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:15.454124 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:15.454124 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:15.454124 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:15.454124 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:01:15.454124 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:01:15.454124 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:01:15.454124 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:01:15.455897 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:15.455897 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:15.455897 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:01:15.455897 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:01:15.455897 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:01:15.455897 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:01:15.455897 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:15.455897 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:15.455897 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:15.455897 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:15.455897 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:15.455897 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:15.455897 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:15.455897 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:15.455897 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:15.455897 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:15.455897 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:15.455897 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:15.456900 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:15.456900 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:15.456900 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:01:15.456900 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:01:15.456900 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:01:15.456900 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:01:15.456900 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:01:15.456900 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:01:15.456900 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 04:01:15.456900 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:15.459480 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944b3cf-5026-48e1-adb7-98b7c62593ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:15.459906 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 287/559] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 04:01:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:15.460435 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944b3cf-5026-48e1-adb7-98b7c62593ad None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:15.460716 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944b3cf-5026-48e1-adb7-98b7c62593ad None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:15.460820 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08a139-f701-4113-938e-902d60e7582d None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:15.460989 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944b3cf-5026-48e1-adb7-98b7c62593ad None admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:15.461640 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3944b3cf-5026-48e1-adb7-98b7c62593ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:15.461937 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3944b3cf-5026-48e1-adb7-98b7c62593ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:15.463344 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3944b3cf-5026-48e1-adb7-98b7c62593ad None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:15.475122 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 273/560] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 04:01:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:15.475990 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944b3cf-5026-48e1-adb7-98b7c62593ad None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:15.476626 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:15.529352 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:15.564242 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08a139-f701-4113-938e-902d60e7582d None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:15.582107 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944b3cf-5026-48e1-adb7-98b7c62593ad None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:15.602006 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b830aa-1b85-4f9a-8b49-292a23d2c3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:15.602625 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b830aa-1b85-4f9a-8b49-292a23d2c3f8 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:15.602902 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b830aa-1b85-4f9a-8b49-292a23d2c3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:15.603173 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b830aa-1b85-4f9a-8b49-292a23d2c3f8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:15.611041 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b830aa-1b85-4f9a-8b49-292a23d2c3f8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:15.612541 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b830aa-1b85-4f9a-8b49-292a23d2c3f8 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:15.616714 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e105795-a543-4745-b50b-f3ff8f678d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:15.617346 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e105795-a543-4745-b50b-f3ff8f678d10 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:15.617605 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e105795-a543-4745-b50b-f3ff8f678d10 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:15.617870 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e105795-a543-4745-b50b-f3ff8f678d10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:15.624144 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-48b830aa-1b85-4f9a-8b49-292a23d2c3f8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 04:01:15.624144 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:15.624144 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:15.624144 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:15.624144 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:15.624144 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:15.624144 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:15.624144 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:15.624144 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:15.624144 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:15.624144 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:15.624144 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:15.624144 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:01:15.624144 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:01:15.624144 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:01:15.624144 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:01:15.625066 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:15.625066 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:15.625066 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:01:15.625066 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:01:15.625066 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:01:15.625066 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:01:15.625066 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:15.625066 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:15.625066 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:15.625066 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:15.625066 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:15.625066 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:15.625066 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:15.625066 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:15.625066 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:15.625066 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:15.625066 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:15.625066 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:15.626039 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:15.626039 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:15.626039 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:01:15.626039 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:01:15.626039 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:01:15.626039 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:01:15.626039 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:01:15.626039 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:01:15.626039 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 04:01:15.626039 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:15.626578 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e105795-a543-4745-b50b-f3ff8f678d10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:15.626654 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 288/561] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 04:01:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:15.626654 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b830aa-1b85-4f9a-8b49-292a23d2c3f8 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:15.626774 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e105795-a543-4745-b50b-f3ff8f678d10 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:15.640791 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-0e105795-a543-4745-b50b-f3ff8f678d10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:01:15.640791 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:15.640791 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:15.640791 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:15.640791 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:15.640791 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:15.640791 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:15.640791 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:15.640791 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:15.640791 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:15.640791 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:15.640791 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:15.640791 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:01:15.640791 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:01:15.640791 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:01:15.641881 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:01:15.641881 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:15.641881 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:15.641881 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:15.641881 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:15.641881 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:15.641881 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:15.641881 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:15.641881 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:15.641881 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:15.641881 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:15.641881 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:15.641881 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:15.641881 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:15.641881 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:15.641881 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:15.641881 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:15.642998 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:01:15.642998 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:01:15.642998 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:01:15.642998 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:01:15.642998 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:01:15.642998 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:01:15.642998 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:01:15.642998 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:15.643502 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 274/562] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 24 04:01:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:15.644058 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e105795-a543-4745-b50b-f3ff8f678d10 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:15.702700 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:15.732820 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b830aa-1b85-4f9a-8b49-292a23d2c3f8 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:15.750607 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e105795-a543-4745-b50b-f3ff8f678d10 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:15.760081 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:15.766607 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf01259-7346-462d-8b1d-ba0ea66b30e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:15.767235 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf01259-7346-462d-8b1d-ba0ea66b30e1 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:15.767516 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf01259-7346-462d-8b1d-ba0ea66b30e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:15.767790 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf01259-7346-462d-8b1d-ba0ea66b30e1 None admin] PATH_INFO: `/v3/users` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:15.768516 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf01259-7346-462d-8b1d-ba0ea66b30e1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:15.768818 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf01259-7346-462d-8b1d-ba0ea66b30e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:15.770254 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf01259-7346-462d-8b1d-ba0ea66b30e1 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:15.787968 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 289/563] 10.222.0.15 () {56 vars in 1137 bytes} [Wed Aug 24 04:01:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:15.788903 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf01259-7346-462d-8b1d-ba0ea66b30e1 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:15.792968 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a31bec-7827-4745-9059-62d17bb88317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:15.793676 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a31bec-7827-4745-9059-62d17bb88317 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:15.794017 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a31bec-7827-4745-9059-62d17bb88317 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:15.794317 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a31bec-7827-4745-9059-62d17bb88317 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:15.802862 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a31bec-7827-4745-9059-62d17bb88317 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:15.804375 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a31bec-7827-4745-9059-62d17bb88317 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:15.815953 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-e3a31bec-7827-4745-9059-62d17bb88317 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 04:01:15.815953 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:15.815953 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:15.815953 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:15.815953 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:15.815953 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:15.815953 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:15.815953 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:15.815953 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:15.815953 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:15.815953 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:15.815953 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:15.815953 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:01:15.815953 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:01:15.815953 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:01:15.815953 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:01:15.817061 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:15.817061 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:15.817061 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:01:15.817061 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:01:15.817061 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:01:15.817061 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:01:15.817061 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:15.817061 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:15.817061 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:15.817061 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:15.817061 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:15.817061 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:15.817061 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:15.817061 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:15.817061 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:15.817061 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:15.817061 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:15.817061 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:15.817992 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:15.817992 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:15.817992 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:01:15.817992 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:01:15.817992 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:01:15.817992 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:01:15.817992 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:01:15.817992 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:01:15.817992 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 04:01:15.817992 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:15.817992 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 275/564] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Aug 24 04:01:15 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:15.817992 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a31bec-7827-4745-9059-62d17bb88317 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:15.893900 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf01259-7346-462d-8b1d-ba0ea66b30e1 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:15.924611 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:15.928053 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a31bec-7827-4745-9059-62d17bb88317 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:15.931291 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffe987-627b-46ac-97f3-42b491e3d864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:15.932032 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffe987-627b-46ac-97f3-42b491e3d864 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:15.932300 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffe987-627b-46ac-97f3-42b491e3d864 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:15.932581 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffe987-627b-46ac-97f3-42b491e3d864 None admin] PATH_INFO: `/v3/users` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:15.933314 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ffe987-627b-46ac-97f3-42b491e3d864 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:15.933623 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ffe987-627b-46ac-97f3-42b491e3d864 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:15.935079 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ffe987-627b-46ac-97f3-42b491e3d864 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:15.953203 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 290/565] 10.222.0.15 () {56 vars in 1137 bytes} [Wed Aug 24 04:01:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:15.953886 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffe987-627b-46ac-97f3-42b491e3d864 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:15.968502 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668d2c5-4eee-4d39-b3f1-84453e5a45e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:15.969100 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668d2c5-4eee-4d39-b3f1-84453e5a45e9 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:15.969378 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668d2c5-4eee-4d39-b3f1-84453e5a45e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:15.969649 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668d2c5-4eee-4d39-b3f1-84453e5a45e9 None admin] PATH_INFO: `/v3/projects` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:15.970342 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f668d2c5-4eee-4d39-b3f1-84453e5a45e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:15.970646 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f668d2c5-4eee-4d39-b3f1-84453e5a45e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:15.972133 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f668d2c5-4eee-4d39-b3f1-84453e5a45e9 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:15.984485 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 276/566] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 24 04:01:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:15.985313 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668d2c5-4eee-4d39-b3f1-84453e5a45e9 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:16.013142 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:16.054154 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffe987-627b-46ac-97f3-42b491e3d864 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:16.086531 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668d2c5-4eee-4d39-b3f1-84453e5a45e9 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:16.088001 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc73ec0-5a6e-4446-829c-494f10c454e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:16.088634 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc73ec0-5a6e-4446-829c-494f10c454e2 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:16.088910 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc73ec0-5a6e-4446-829c-494f10c454e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:16.089182 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc73ec0-5a6e-4446-829c-494f10c454e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:16.100144 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc73ec0-5a6e-4446-829c-494f10c454e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:16.101596 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc73ec0-5a6e-4446-829c-494f10c454e2 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:16.116756 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-cfc73ec0-5a6e-4446-829c-494f10c454e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:16.116756 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:16.116756 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:16.116756 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:16.116756 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:16.116756 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:16.116756 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:16.116756 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:16.116756 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:16.116756 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:16.116756 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:16.116756 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:16.116756 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:01:16.116756 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:01:16.116756 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:01:16.116756 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:01:16.117823 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:16.117823 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:16.117823 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:16.117823 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:16.117823 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:16.117823 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:16.117823 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:16.117823 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:16.117823 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:16.117823 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:16.117823 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:16.117823 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:16.117823 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:16.117823 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:16.117823 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:16.117823 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:16.117823 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:01:16.118872 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:01:16.118872 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:16.118872 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:16.118872 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 291/567] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:01:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:16.119121 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc73ec0-5a6e-4446-829c-494f10c454e2 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:16.125511 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c00f1-4227-49a0-924e-9b1f441e4577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:16.126122 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c00f1-4227-49a0-924e-9b1f441e4577 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:16.126399 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c00f1-4227-49a0-924e-9b1f441e4577 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:16.126667 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c00f1-4227-49a0-924e-9b1f441e4577 None admin] PATH_INFO: `/v3/users` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:16.127439 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c00f1-4227-49a0-924e-9b1f441e4577 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:16.128145 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c00f1-4227-49a0-924e-9b1f441e4577 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:16.129956 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c00f1-4227-49a0-924e-9b1f441e4577 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:16.149489 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 277/568] 10.222.0.15 () {56 vars in 1139 bytes} [Wed Aug 24 04:01:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:16.150335 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c00f1-4227-49a0-924e-9b1f441e4577 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:16.165270 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:16.223487 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc73ec0-5a6e-4446-829c-494f10c454e2 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:16.235999 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:16.251867 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c00f1-4227-49a0-924e-9b1f441e4577 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:16.260997 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b1691-1dd4-4609-bcc7-9dbf1b07fd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:16.261622 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b1691-1dd4-4609-bcc7-9dbf1b07fd24 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:16.261901 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b1691-1dd4-4609-bcc7-9dbf1b07fd24 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:16.262179 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b1691-1dd4-4609-bcc7-9dbf1b07fd24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:16.272723 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b1691-1dd4-4609-bcc7-9dbf1b07fd24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:16.274194 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b1691-1dd4-4609-bcc7-9dbf1b07fd24 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:16.285324 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51814526-0da8-40f1-8b2a-9eb36734745d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:16.285975 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51814526-0da8-40f1-8b2a-9eb36734745d None admin] REQUEST_METHOD: `PUT` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:16.286252 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51814526-0da8-40f1-8b2a-9eb36734745d None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:16.286525 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51814526-0da8-40f1-8b2a-9eb36734745d None admin] PATH_INFO: `/v3/projects/5c317b3ce1d1468f95bc01ba2587e623/users/3796b1549762419686cb3b00af1a963e/roles/4278d3d9834d462b821b63a99db9229a` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:16.288006 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-1d3b1691-1dd4-4609-bcc7-9dbf1b07fd24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:16.288006 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:16.288006 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:16.288006 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:16.288006 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:16.288006 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:16.288006 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:16.288006 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:16.288006 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:16.288006 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:16.288006 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:16.288006 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:16.288006 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:01:16.288006 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:01:16.288006 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:01:16.288006 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:01:16.289062 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:16.289062 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:16.289062 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:16.289062 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:16.289062 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:16.289062 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:16.289062 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:16.289062 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:16.289062 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:16.289062 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:16.289062 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:16.289062 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:16.289062 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:16.289062 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:16.289062 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:16.289062 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:16.289062 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:01:16.290145 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:01:16.290145 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:16.290145 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:16.290145 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 292/569] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:01:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:16.290425 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b1691-1dd4-4609-bcc7-9dbf1b07fd24 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:16.305965 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51814526-0da8-40f1-8b2a-9eb36734745d None admin] RBAC: Authorizing `identity:create_grant(project_id=5c317b3ce1d1468f95bc01ba2587e623, user_id=3796b1549762419686cb3b00af1a963e, role_id=4278d3d9834d462b821b63a99db9229a)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:16.307468 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51814526-0da8-40f1-8b2a-9eb36734745d None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:16.320361 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 278/570] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Aug 24 04:01:16 2022] PUT /identity/v3/projects/5c317b3ce1d1468f95bc01ba2587e623/users/3796b1549762419686cb3b00af1a963e/roles/4278d3d9834d462b821b63a99db9229a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:01:16.321156 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51814526-0da8-40f1-8b2a-9eb36734745d None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:16.402370 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:16.414237 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b1691-1dd4-4609-bcc7-9dbf1b07fd24 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:16.437575 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51814526-0da8-40f1-8b2a-9eb36734745d None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:16.456302 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422b484-f157-4ab1-b58a-ca45785b78fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:16.456948 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422b484-f157-4ab1-b58a-ca45785b78fc None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:16.457236 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422b484-f157-4ab1-b58a-ca45785b78fc None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:16.457504 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422b484-f157-4ab1-b58a-ca45785b78fc None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:16.458336 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422b484-f157-4ab1-b58a-ca45785b78fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:16.458647 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422b484-f157-4ab1-b58a-ca45785b78fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:16.460408 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422b484-f157-4ab1-b58a-ca45785b78fc None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:16.476199 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 293/571] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 04:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:16.480450 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ee4d4-c1e7-42b8-b272-3169dc329aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:16.481191 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ee4d4-c1e7-42b8-b272-3169dc329aba None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:16.481473 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ee4d4-c1e7-42b8-b272-3169dc329aba None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:16.481743 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ee4d4-c1e7-42b8-b272-3169dc329aba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:16.481925 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422b484-f157-4ab1-b58a-ca45785b78fc None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:16.485169 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:16.496578 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ee4d4-c1e7-42b8-b272-3169dc329aba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:16.498531 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ee4d4-c1e7-42b8-b272-3169dc329aba None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:16.517796 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-9d5ee4d4-c1e7-42b8-b272-3169dc329aba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:16.517796 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:16.517796 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:16.517796 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:16.517796 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:16.517796 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:16.517796 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:16.517796 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:16.517796 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:16.517796 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:16.517796 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:16.517796 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:16.517796 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:01:16.517796 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:01:16.517796 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:01:16.517796 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:01:16.518958 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:16.518958 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:16.518958 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:16.518958 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:16.518958 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:16.518958 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:16.518958 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:16.518958 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:16.518958 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:16.518958 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:16.518958 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:16.518958 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:16.518958 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:16.518958 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:16.518958 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:16.518958 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:16.518958 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:01:16.519885 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:01:16.519885 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:16.519885 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:16.519885 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 279/572] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:01:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:16.519885 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ee4d4-c1e7-42b8-b272-3169dc329aba None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:16.605316 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422b484-f157-4ab1-b58a-ca45785b78fc None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:16.634443 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ee4d4-c1e7-42b8-b272-3169dc329aba None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:16.639734 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97556ef9-0e6b-4a1c-967b-080aece9ad7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:16.640339 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97556ef9-0e6b-4a1c-967b-080aece9ad7a None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:16.640613 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97556ef9-0e6b-4a1c-967b-080aece9ad7a None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:16.640877 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97556ef9-0e6b-4a1c-967b-080aece9ad7a None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:16.641506 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97556ef9-0e6b-4a1c-967b-080aece9ad7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:16.641808 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97556ef9-0e6b-4a1c-967b-080aece9ad7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:16.643158 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97556ef9-0e6b-4a1c-967b-080aece9ad7a None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:16.654795 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 294/573] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 04:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:16.657149 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97556ef9-0e6b-4a1c-967b-080aece9ad7a None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:16.671707 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0e5c2-37c4-44ee-9ee2-c19fc0d5c468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:16.672510 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0e5c2-37c4-44ee-9ee2-c19fc0d5c468 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:16.672879 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0e5c2-37c4-44ee-9ee2-c19fc0d5c468 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:16.673260 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0e5c2-37c4-44ee-9ee2-c19fc0d5c468 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:16.674332 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:16.680680 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f0e5c2-37c4-44ee-9ee2-c19fc0d5c468 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:16.682255 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f0e5c2-37c4-44ee-9ee2-c19fc0d5c468 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:16.693587 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-a6f0e5c2-37c4-44ee-9ee2-c19fc0d5c468 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:01:16.693587 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:16.693587 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:16.693587 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:16.693587 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:16.693587 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:16.693587 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:16.693587 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:16.693587 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:16.693587 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:16.693587 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:16.693587 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:16.693587 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:01:16.693587 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:01:16.693587 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:01:16.695066 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:01:16.695066 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:16.695066 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:16.695066 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:16.695066 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:16.695066 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:16.695066 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:16.695066 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:16.695066 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:16.695066 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:16.695066 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:16.695066 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:16.695066 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:16.695066 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:16.695066 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:16.695066 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:16.695066 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:16.696195 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:01:16.696195 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:01:16.696195 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:01:16.696195 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:01:16.696195 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:01:16.696195 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:01:16.696195 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:01:16.696195 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:16.696935 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 280/574] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 24 04:01:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:16.697716 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0e5c2-37c4-44ee-9ee2-c19fc0d5c468 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:16.754342 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:16.769228 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97556ef9-0e6b-4a1c-967b-080aece9ad7a None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:16.804534 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bca7e1-54a9-4a5d-b328-308bf47dd345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:16.805136 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bca7e1-54a9-4a5d-b328-308bf47dd345 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:16.805470 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bca7e1-54a9-4a5d-b328-308bf47dd345 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:16.805665 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bca7e1-54a9-4a5d-b328-308bf47dd345 None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:16.806307 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bca7e1-54a9-4a5d-b328-308bf47dd345 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:16.806605 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bca7e1-54a9-4a5d-b328-308bf47dd345 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:16.807990 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bca7e1-54a9-4a5d-b328-308bf47dd345 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:16.814862 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0e5c2-37c4-44ee-9ee2-c19fc0d5c468 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:16.826581 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 295/575] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 04:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:16.826581 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bca7e1-54a9-4a5d-b328-308bf47dd345 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:16.855357 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446682ea-e1cc-44c3-ab53-4f8f5b0c9c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:16.856147 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446682ea-e1cc-44c3-ab53-4f8f5b0c9c5e None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:16.856533 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446682ea-e1cc-44c3-ab53-4f8f5b0c9c5e None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:16.856904 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446682ea-e1cc-44c3-ab53-4f8f5b0c9c5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:16.864081 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446682ea-e1cc-44c3-ab53-4f8f5b0c9c5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:16.865659 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446682ea-e1cc-44c3-ab53-4f8f5b0c9c5e None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:16.878032 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-446682ea-e1cc-44c3-ab53-4f8f5b0c9c5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:01:16.878032 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:16.878032 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:16.878032 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:16.878032 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:16.878032 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:16.878032 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:16.878032 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:16.878032 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:16.878032 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:16.878032 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:16.878032 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:16.878032 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:01:16.878032 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:01:16.878032 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:01:16.879068 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:01:16.879068 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:16.879068 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:16.879068 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:16.879068 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:16.879068 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:16.879068 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:16.879068 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:16.879068 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:16.879068 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:16.879068 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:16.879068 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:16.879068 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:16.879068 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:16.879068 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:16.879068 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:16.879068 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:16.880090 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:01:16.880090 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:01:16.880090 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:01:16.880090 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:01:16.880090 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:01:16.880090 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:01:16.880090 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:01:16.880090 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:16.883901 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 281/576] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 24 04:01:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:16.884757 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446682ea-e1cc-44c3-ab53-4f8f5b0c9c5e None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:16.908578 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:16.944079 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bca7e1-54a9-4a5d-b328-308bf47dd345 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:16.988511 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a448f-ad42-4d3a-b608-f58089b3bd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:16.989117 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a448f-ad42-4d3a-b608-f58089b3bd0d None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:16.989392 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a448f-ad42-4d3a-b608-f58089b3bd0d None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:16.989658 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a448f-ad42-4d3a-b608-f58089b3bd0d None admin] PATH_INFO: `/v3/projects` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:16.990348 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a448f-ad42-4d3a-b608-f58089b3bd0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:16.990674 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a448f-ad42-4d3a-b608-f58089b3bd0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:16.992167 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a448f-ad42-4d3a-b608-f58089b3bd0d None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:16.999227 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446682ea-e1cc-44c3-ab53-4f8f5b0c9c5e None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:17.010140 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 296/577] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 24 04:01:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:17.010140 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a448f-ad42-4d3a-b608-f58089b3bd0d None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:17.014725 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:17.042502 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b426e-e108-4a59-95b2-88b63d7d0782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:17.043427 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b426e-e108-4a59-95b2-88b63d7d0782 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:17.043706 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b426e-e108-4a59-95b2-88b63d7d0782 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:17.043978 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b426e-e108-4a59-95b2-88b63d7d0782 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:17.050709 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16b426e-e108-4a59-95b2-88b63d7d0782 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:17.052220 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16b426e-e108-4a59-95b2-88b63d7d0782 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:17.064588 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-a16b426e-e108-4a59-95b2-88b63d7d0782 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:01:17.064588 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:17.064588 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:17.064588 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:17.064588 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:17.064588 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:17.064588 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:17.064588 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:17.064588 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:17.064588 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:17.064588 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:17.064588 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:17.064588 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:01:17.064588 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:01:17.064588 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:01:17.065511 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:01:17.065511 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:17.065511 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:17.065511 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:17.065511 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:17.065511 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:17.065511 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:17.065511 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:17.065511 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:17.065511 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:17.065511 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:17.065511 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:17.065511 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:17.065511 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:17.065511 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:17.065511 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:17.065511 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:17.066368 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:01:17.066368 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:01:17.066368 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:01:17.066368 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:01:17.066368 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:01:17.066368 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:01:17.066368 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:01:17.066368 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:17.066368 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 282/578] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 24 04:01:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:17.066855 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b426e-e108-4a59-95b2-88b63d7d0782 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:17.128512 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a448f-ad42-4d3a-b608-f58089b3bd0d None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:17.159897 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:17.165545 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fdcaba-355f-4c9e-b6e8-c142e0c8b555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:17.166333 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdcaba-355f-4c9e-b6e8-c142e0c8b555 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:17.166615 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdcaba-355f-4c9e-b6e8-c142e0c8b555 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:17.167238 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdcaba-355f-4c9e-b6e8-c142e0c8b555 None admin] PATH_INFO: `/v3/projects` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:17.167943 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fdcaba-355f-4c9e-b6e8-c142e0c8b555 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:17.168251 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fdcaba-355f-4c9e-b6e8-c142e0c8b555 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:17.169742 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fdcaba-355f-4c9e-b6e8-c142e0c8b555 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:17.175742 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b426e-e108-4a59-95b2-88b63d7d0782 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:17.181450 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 297/579] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 24 04:01:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:17.182265 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fdcaba-355f-4c9e-b6e8-c142e0c8b555 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:17.215184 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56717f8c-09b7-4b32-9f9f-3fd64272f4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:17.216244 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56717f8c-09b7-4b32-9f9f-3fd64272f4ca None admin] REQUEST_METHOD: `PUT` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:17.216724 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56717f8c-09b7-4b32-9f9f-3fd64272f4ca None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:17.217264 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56717f8c-09b7-4b32-9f9f-3fd64272f4ca None admin] PATH_INFO: `/v3/projects/5c317b3ce1d1468f95bc01ba2587e623/users/7da73e8a2c7a4c5aafd1d3fbea603970/roles/4278d3d9834d462b821b63a99db9229a` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:17.233232 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56717f8c-09b7-4b32-9f9f-3fd64272f4ca None admin] RBAC: Authorizing `identity:create_grant(project_id=5c317b3ce1d1468f95bc01ba2587e623, user_id=7da73e8a2c7a4c5aafd1d3fbea603970, role_id=4278d3d9834d462b821b63a99db9229a)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:17.234997 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56717f8c-09b7-4b32-9f9f-3fd64272f4ca None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:17.249722 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 283/580] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Aug 24 04:01:17 2022] PUT /identity/v3/projects/5c317b3ce1d1468f95bc01ba2587e623/users/7da73e8a2c7a4c5aafd1d3fbea603970/roles/4278d3d9834d462b821b63a99db9229a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:01:17.250891 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56717f8c-09b7-4b32-9f9f-3fd64272f4ca None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:17.273547 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:17.319411 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fdcaba-355f-4c9e-b6e8-c142e0c8b555 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:17.360364 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18858e-52a3-4d64-9cba-30813a6e9819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:17.360695 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18858e-52a3-4d64-9cba-30813a6e9819 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:17.360971 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18858e-52a3-4d64-9cba-30813a6e9819 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:17.361240 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18858e-52a3-4d64-9cba-30813a6e9819 None admin] PATH_INFO: `/v3/projects` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:17.361965 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb18858e-52a3-4d64-9cba-30813a6e9819 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:17.362403 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb18858e-52a3-4d64-9cba-30813a6e9819 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:17.363823 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb18858e-52a3-4d64-9cba-30813a6e9819 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:17.382655 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 298/581] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 24 04:01:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:17.383678 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18858e-52a3-4d64-9cba-30813a6e9819 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:17.388598 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56717f8c-09b7-4b32-9f9f-3fd64272f4ca None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:17.430045 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7016ac-038d-42f2-ae49-5b7a3913fa08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:17.431303 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7016ac-038d-42f2-ae49-5b7a3913fa08 None admin] REQUEST_METHOD: `PUT` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:17.431796 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7016ac-038d-42f2-ae49-5b7a3913fa08 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:17.432320 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7016ac-038d-42f2-ae49-5b7a3913fa08 None admin] PATH_INFO: `/v3/projects/5c317b3ce1d1468f95bc01ba2587e623/users/9d60ca48fd1b4a4ab4261ad1dbd6c8bc/roles/4278d3d9834d462b821b63a99db9229a` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:17.451866 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7016ac-038d-42f2-ae49-5b7a3913fa08 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c317b3ce1d1468f95bc01ba2587e623, user_id=9d60ca48fd1b4a4ab4261ad1dbd6c8bc, role_id=4278d3d9834d462b821b63a99db9229a)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:17.453662 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7016ac-038d-42f2-ae49-5b7a3913fa08 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:17.463178 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:17.474040 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 284/582] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Aug 24 04:01:17 2022] PUT /identity/v3/projects/5c317b3ce1d1468f95bc01ba2587e623/users/9d60ca48fd1b4a4ab4261ad1dbd6c8bc/roles/4278d3d9834d462b821b63a99db9229a => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:01:17.507472 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18858e-52a3-4d64-9cba-30813a6e9819 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:17.550171 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8df9de-4344-4097-965e-4d6d60626d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:17.551280 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8df9de-4344-4097-965e-4d6d60626d69 None admin] REQUEST_METHOD: `PUT` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:17.551757 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8df9de-4344-4097-965e-4d6d60626d69 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:17.552234 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8df9de-4344-4097-965e-4d6d60626d69 None admin] PATH_INFO: `/v3/projects/5c317b3ce1d1468f95bc01ba2587e623/users/e62f90d6440048e58cf530701a979e87/roles/4278d3d9834d462b821b63a99db9229a` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:17.570971 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8df9de-4344-4097-965e-4d6d60626d69 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c317b3ce1d1468f95bc01ba2587e623, user_id=e62f90d6440048e58cf530701a979e87, role_id=4278d3d9834d462b821b63a99db9229a)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:17.572833 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8df9de-4344-4097-965e-4d6d60626d69 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:17.590225 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 299/583] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Aug 24 04:01:17 2022] PUT /identity/v3/projects/5c317b3ce1d1468f95bc01ba2587e623/users/e62f90d6440048e58cf530701a979e87/roles/4278d3d9834d462b821b63a99db9229a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:01:18.550578 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58643b9e-9bec-47db-a57c-26f00a8bc6a9 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:18.551156 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58643b9e-9bec-47db-a57c-26f00a8bc6a9 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:18.551156 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58643b9e-9bec-47db-a57c-26f00a8bc6a9 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:18.552843 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 285/584] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:01:18.559048 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1ab55-baa5-4a22-b47e-e32dfdda1573 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:18.559612 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1ab55-baa5-4a22-b47e-e32dfdda1573 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:18.559690 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1ab55-baa5-4a22-b47e-e32dfdda1573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:18.578822 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-5bc1ab55-baa5-4a22-b47e-e32dfdda1573 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:01:18.580110 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-5bc1ab55-baa5-4a22-b47e-e32dfdda1573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:18.672549 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 300/585] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:01:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:01:19.017695 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58643b9e-9bec-47db-a57c-26f00a8bc6a9 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:19.097037 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:19.143836 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58643b9e-9bec-47db-a57c-26f00a8bc6a9 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:19.181309 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55fc1f-5568-4f08-8cf8-a757b3bd4e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:19.181867 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55fc1f-5568-4f08-8cf8-a757b3bd4e78 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:19.182139 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55fc1f-5568-4f08-8cf8-a757b3bd4e78 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:19.182408 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55fc1f-5568-4f08-8cf8-a757b3bd4e78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:19.194368 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c55fc1f-5568-4f08-8cf8-a757b3bd4e78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:01:19.199217 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-7c55fc1f-5568-4f08-8cf8-a757b3bd4e78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:01:19.199217 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:19.199217 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:19.199217 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:19.199217 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:19.199217 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:19.199217 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:19.199217 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:19.199217 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:19.199217 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:19.199217 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:19.199217 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:19.199217 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:01:19.199217 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:01:19.199217 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:01:19.199217 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:01:19.200178 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:01:19.200178 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:01:19.200178 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:01:19.200178 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:01:19.200178 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:19.200178 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:19.200178 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:19.200178 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:19.200178 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:19.200178 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:19.200178 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:19.200178 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:19.200178 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:19.200178 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:19.200178 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:19.200178 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:19.200988 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:19.200988 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:19.200988 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:19.200988 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:19.200988 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:01:19.200988 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:01:19.200988 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:01:19.200988 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:01:19.200988 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:01:19.200988 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:01:19.200988 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:01:19.200988 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:19.200988 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 286/586] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Aug 24 04:01:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:19.207229 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc1ab55-baa5-4a22-b47e-e32dfdda1573 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:19.247642 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:19.321643 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc1ab55-baa5-4a22-b47e-e32dfdda1573 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:19.361765 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9554dc-6f4a-408e-9e4a-0e972259e7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:19.362405 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9554dc-6f4a-408e-9e4a-0e972259e7e8 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:19.362686 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9554dc-6f4a-408e-9e4a-0e972259e7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:19.362959 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9554dc-6f4a-408e-9e4a-0e972259e7e8 None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:19.363785 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9554dc-6f4a-408e-9e4a-0e972259e7e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:19.364093 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9554dc-6f4a-408e-9e4a-0e972259e7e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:19.365640 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9554dc-6f4a-408e-9e4a-0e972259e7e8 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:19.381618 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 301/587] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Aug 24 04:01:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:19.383169 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55fc1f-5568-4f08-8cf8-a757b3bd4e78 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:19.526502 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55fc1f-5568-4f08-8cf8-a757b3bd4e78 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:19.533016 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a9fa6-92d5-4ada-9fa4-a173fe7efb16 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:19.533338 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a9fa6-92d5-4ada-9fa4-a173fe7efb16 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:19.536232 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a9fa6-92d5-4ada-9fa4-a173fe7efb16 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:19.536556 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 302/588] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:01:19.540867 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32040c84-15f4-46cd-a160-008de769b0ee None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:19.541152 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32040c84-15f4-46cd-a160-008de769b0ee None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:19.541431 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32040c84-15f4-46cd-a160-008de769b0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:19.560178 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-32040c84-15f4-46cd-a160-008de769b0ee None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:01:19.561396 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-32040c84-15f4-46cd-a160-008de769b0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:19.564272 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:19.573982 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ce8a5-4dea-4a78-ae44-e7ea985eba3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:19.575456 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ce8a5-4dea-4a78-ae44-e7ea985eba3f None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:19.576103 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ce8a5-4dea-4a78-ae44-e7ea985eba3f None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:19.576690 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ce8a5-4dea-4a78-ae44-e7ea985eba3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:19.592094 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ce8a5-4dea-4a78-ae44-e7ea985eba3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:19.594526 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ce8a5-4dea-4a78-ae44-e7ea985eba3f None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:19.613242 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-b94ce8a5-4dea-4a78-ae44-e7ea985eba3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:19.613242 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:19.613242 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:19.613242 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:19.613242 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:19.613242 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:19.613242 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:19.613242 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:19.613242 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:19.613242 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:19.613242 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:19.613242 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:19.613242 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:01:19.613242 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:01:19.613242 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:01:19.613242 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:01:19.614267 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:19.614267 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:19.614267 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:19.614267 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:19.614267 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:19.614267 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:19.614267 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:19.614267 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:19.614267 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:19.614267 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:19.614267 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:19.614267 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:19.614267 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:19.614267 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:19.614267 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:19.614267 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:19.614267 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:01:19.615138 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:01:19.615138 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:19.615138 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:19.615138 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 287/589] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:01:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:19.620574 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ce8a5-4dea-4a78-ae44-e7ea985eba3f None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:19.667444 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 303/590] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:01:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:01:19.750863 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ce8a5-4dea-4a78-ae44-e7ea985eba3f None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:19.786677 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45566f-2429-453c-8ae8-60cddac9cbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:19.787214 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45566f-2429-453c-8ae8-60cddac9cbe1 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:19.787545 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45566f-2429-453c-8ae8-60cddac9cbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:19.787820 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45566f-2429-453c-8ae8-60cddac9cbe1 None admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:19.788461 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a45566f-2429-453c-8ae8-60cddac9cbe1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:19.788759 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a45566f-2429-453c-8ae8-60cddac9cbe1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:19.790154 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a45566f-2429-453c-8ae8-60cddac9cbe1 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:19.803494 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 288/591] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 04:01:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:19.808976 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32040c84-15f4-46cd-a160-008de769b0ee None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:19.837077 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:19.892429 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa32986-3a10-4bd7-a61f-4ab8e735c1c7 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:19.892688 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa32986-3a10-4bd7-a61f-4ab8e735c1c7 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:19.892963 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa32986-3a10-4bd7-a61f-4ab8e735c1c7 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:19.894319 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 289/592] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:01:19.902849 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c1a03-4ddd-4934-a19a-a92e0478161a None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:19.903226 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c1a03-4ddd-4934-a19a-a92e0478161a None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:19.903417 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c1a03-4ddd-4934-a19a-a92e0478161a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:19.934936 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32040c84-15f4-46cd-a160-008de769b0ee None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:19.943289 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-4b4c1a03-4ddd-4934-a19a-a92e0478161a None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:01:19.945202 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-4b4c1a03-4ddd-4934-a19a-a92e0478161a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:19.979804 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b022d08-1a61-4cbf-97d1-39fd7870ca9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:19.980438 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b022d08-1a61-4cbf-97d1-39fd7870ca9b None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:19.980718 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b022d08-1a61-4cbf-97d1-39fd7870ca9b None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:19.981001 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b022d08-1a61-4cbf-97d1-39fd7870ca9b None admin] PATH_INFO: `/v3/users/nova` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:19.989184 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b022d08-1a61-4cbf-97d1-39fd7870ca9b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:19.990674 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b022d08-1a61-4cbf-97d1-39fd7870ca9b None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:19.997618 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:20.004249 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-6b022d08-1a61-4cbf-97d1-39fd7870ca9b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:01:20.004249 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:20.004249 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:20.004249 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:20.004249 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:20.004249 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:20.004249 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:20.004249 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:20.004249 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:20.004249 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:20.004249 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:20.004249 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:20.004249 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:01:20.004249 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:01:20.004249 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:01:20.004249 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:01:20.005303 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:20.005303 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:20.005303 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:01:20.005303 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:01:20.005303 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:01:20.005303 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:01:20.005303 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:20.005303 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:20.005303 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:20.005303 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:20.005303 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:20.005303 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:20.005303 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:20.005303 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:20.005303 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:20.005303 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:20.005303 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:20.005303 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:20.006202 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:20.006202 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:20.006202 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:01:20.006202 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:01:20.006202 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:01:20.006202 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:01:20.006202 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:01:20.006202 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:01:20.006202 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:01:20.006202 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:20.010174 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 304/593] 10.222.0.15 () {56 vars in 1093 bytes} [Wed Aug 24 04:01:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:20.011600 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b022d08-1a61-4cbf-97d1-39fd7870ca9b None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:20.042038 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 290/594] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:01:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:01:20.043174 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c1a03-4ddd-4934-a19a-a92e0478161a None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:20.123978 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:20.145871 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b022d08-1a61-4cbf-97d1-39fd7870ca9b None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:20.155014 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c1a03-4ddd-4934-a19a-a92e0478161a None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:20.183806 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f1a23-162c-497e-8dbf-04cdb99d3782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:20.184950 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f1a23-162c-497e-8dbf-04cdb99d3782 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:20.185367 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f1a23-162c-497e-8dbf-04cdb99d3782 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:20.185646 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f1a23-162c-497e-8dbf-04cdb99d3782 None admin] PATH_INFO: `/v3/users` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:20.186394 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8f1a23-162c-497e-8dbf-04cdb99d3782 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:20.186702 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8f1a23-162c-497e-8dbf-04cdb99d3782 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:20.188424 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8f1a23-162c-497e-8dbf-04cdb99d3782 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:20.193352 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62116703-95b7-4d9a-86f4-1178af79d17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:20.194381 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62116703-95b7-4d9a-86f4-1178af79d17a None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:20.194659 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62116703-95b7-4d9a-86f4-1178af79d17a None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:20.194926 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62116703-95b7-4d9a-86f4-1178af79d17a None admin] PATH_INFO: `/v3/roles/service` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:20.205866 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62116703-95b7-4d9a-86f4-1178af79d17a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:01:20.210630 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-62116703-95b7-4d9a-86f4-1178af79d17a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:01:20.210630 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:20.210630 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:20.210630 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:20.210630 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:20.210630 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:20.210630 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:20.210630 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:20.210630 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:20.210630 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:20.210630 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:20.210630 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:20.210630 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:01:20.210630 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:01:20.210630 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:01:20.210630 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:01:20.211831 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:01:20.211831 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:01:20.211831 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:01:20.211831 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:01:20.211831 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:20.211831 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:20.211831 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:20.211831 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:20.211831 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:20.211831 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:20.211831 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:20.211831 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:20.211831 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:20.211831 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:20.211831 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:20.211831 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:20.212646 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:20.212646 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:20.212646 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:20.212646 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:20.212646 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:01:20.212646 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:01:20.212646 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:01:20.212646 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:01:20.212646 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:01:20.212646 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:01:20.212646 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:01:20.212646 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:20.213272 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 305/595] 10.222.0.15 () {56 vars in 1133 bytes} [Wed Aug 24 04:01:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:01:20.213354 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 291/596] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Aug 24 04:01:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:20.217578 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62116703-95b7-4d9a-86f4-1178af79d17a None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:20.218090 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6791fc4-3157-467f-90ee-912813bbd857 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:20.219507 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6791fc4-3157-467f-90ee-912813bbd857 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:20.219629 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6791fc4-3157-467f-90ee-912813bbd857 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:20.227774 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 306/597] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:01:20 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:01:20.228623 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6791fc4-3157-467f-90ee-912813bbd857 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:20.256363 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:20.343050 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62116703-95b7-4d9a-86f4-1178af79d17a None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:20.366258 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6791fc4-3157-467f-90ee-912813bbd857 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:20.379940 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ea82f-81d8-4442-a229-57854c7550a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:20.380561 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ea82f-81d8-4442-a229-57854c7550a9 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:20.380839 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ea82f-81d8-4442-a229-57854c7550a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:20.381113 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ea82f-81d8-4442-a229-57854c7550a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:20.400392 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b201c-8e8b-405e-85fc-146d890df936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:20.400994 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b201c-8e8b-405e-85fc-146d890df936 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:20.401299 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b201c-8e8b-405e-85fc-146d890df936 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:20.401571 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b201c-8e8b-405e-85fc-146d890df936 None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:20.402244 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b201c-8e8b-405e-85fc-146d890df936 None admin] RBAC: Adding query filter params (name=service) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:20.402597 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b201c-8e8b-405e-85fc-146d890df936 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:20.403994 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b201c-8e8b-405e-85fc-146d890df936 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:20.412177 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 307/598] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Aug 24 04:01:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:20.413523 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689c9e6-8bc0-4f6b-abbb-b954fc9b4df5 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:20.413812 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689c9e6-8bc0-4f6b-abbb-b954fc9b4df5 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:20.414068 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689c9e6-8bc0-4f6b-abbb-b954fc9b4df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:20.421404 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:20.432735 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-a689c9e6-8bc0-4f6b-abbb-b954fc9b4df5 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:01:20.433942 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-a689c9e6-8bc0-4f6b-abbb-b954fc9b4df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:20.448859 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190ea82f-81d8-4442-a229-57854c7550a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:20.450321 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190ea82f-81d8-4442-a229-57854c7550a9 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:20.478496 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:20.504422 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 308/599] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:01:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:01:20.505307 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689c9e6-8bc0-4f6b-abbb-b954fc9b4df5 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:20.554665 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 292/600] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 24 04:01:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 04:01:20.554665 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ea82f-81d8-4442-a229-57854c7550a9 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:20.610673 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689c9e6-8bc0-4f6b-abbb-b954fc9b4df5 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:20.646575 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51a015-26ab-4f79-a3ab-628f10f4be5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:20.647468 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51a015-26ab-4f79-a3ab-628f10f4be5e None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:20.647578 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51a015-26ab-4f79-a3ab-628f10f4be5e None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:20.647894 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51a015-26ab-4f79-a3ab-628f10f4be5e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:20.650175 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:20.664400 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b51a015-26ab-4f79-a3ab-628f10f4be5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:01:20.664626 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ea82f-81d8-4442-a229-57854c7550a9 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:20.669089 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-9b51a015-26ab-4f79-a3ab-628f10f4be5e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:01:20.669089 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:20.669089 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:20.669089 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:20.669089 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:20.669089 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:20.669089 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:20.669089 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:20.669089 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:20.669089 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:20.669089 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:20.669089 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:20.669089 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:01:20.669089 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:01:20.669089 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:01:20.669089 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:01:20.669976 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:01:20.669976 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:01:20.669976 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:01:20.669976 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:01:20.669976 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:20.669976 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:20.669976 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:20.669976 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:20.669976 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:20.669976 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:20.669976 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:20.669976 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:20.669976 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:20.669976 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:20.669976 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:20.669976 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:20.670811 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:20.670811 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:20.670811 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:20.670811 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:20.670811 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:01:20.670811 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:01:20.670811 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:01:20.670811 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:01:20.670811 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:01:20.670811 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:01:20.670811 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:01:20.670811 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:20.675035 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 309/601] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Aug 24 04:01:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:20.675805 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51a015-26ab-4f79-a3ab-628f10f4be5e None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:20.697414 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:20.704388 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da0ea1-f38f-4539-abbf-f545c7981ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:20.705023 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da0ea1-f38f-4539-abbf-f545c7981ad0 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:20.705299 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da0ea1-f38f-4539-abbf-f545c7981ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:20.705620 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da0ea1-f38f-4539-abbf-f545c7981ad0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:20.718683 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24da0ea1-f38f-4539-abbf-f545c7981ad0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:20.720540 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24da0ea1-f38f-4539-abbf-f545c7981ad0 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:20.738657 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-24da0ea1-f38f-4539-abbf-f545c7981ad0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:20.738657 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:20.738657 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:20.738657 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:20.738657 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:20.738657 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:20.738657 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:20.738657 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:20.738657 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:20.738657 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:20.738657 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:20.738657 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:20.738657 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:01:20.738657 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:01:20.738657 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:01:20.738657 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:01:20.744775 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:20.744775 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:20.744775 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:20.744775 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:20.744775 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:20.744775 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:20.744775 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:20.744775 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:20.744775 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:20.744775 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:20.744775 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:20.744775 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:20.744775 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:20.744775 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:20.744775 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:20.744775 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:20.744775 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:01:20.745699 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:01:20.745699 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:20.745699 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:20.745699 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 293/602] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:01:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:20.745699 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da0ea1-f38f-4539-abbf-f545c7981ad0 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:20.781042 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51a015-26ab-4f79-a3ab-628f10f4be5e None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:20.816993 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd9367-8ff0-4574-bf88-caf928317b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:20.817604 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd9367-8ff0-4574-bf88-caf928317b53 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:20.817890 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd9367-8ff0-4574-bf88-caf928317b53 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:20.818154 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd9367-8ff0-4574-bf88-caf928317b53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:20.829030 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fd9367-8ff0-4574-bf88-caf928317b53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:20.830478 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fd9367-8ff0-4574-bf88-caf928317b53 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:20.844853 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-c5fd9367-8ff0-4574-bf88-caf928317b53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:20.844853 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:20.844853 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:20.844853 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:20.844853 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:20.844853 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:20.844853 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:20.844853 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:20.844853 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:20.844853 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:20.844853 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:20.844853 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:20.844853 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:01:20.844853 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:01:20.844853 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:01:20.844853 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:01:20.845923 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:20.845923 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:20.845923 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:20.845923 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:20.845923 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:20.845923 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:20.845923 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:20.845923 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:20.845923 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:20.845923 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:20.845923 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:20.845923 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:20.845923 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:20.845923 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:20.845923 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:20.845923 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:20.845923 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:01:20.846787 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:01:20.846787 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:20.846787 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:20.846787 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 310/603] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:01:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:20.846787 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd9367-8ff0-4574-bf88-caf928317b53 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:20.857169 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da0ea1-f38f-4539-abbf-f545c7981ad0 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:20.891093 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fee6d3-3ed3-4f43-aa50-fad776a3d935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:20.891805 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fee6d3-3ed3-4f43-aa50-fad776a3d935 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:20.892150 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fee6d3-3ed3-4f43-aa50-fad776a3d935 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:20.892494 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fee6d3-3ed3-4f43-aa50-fad776a3d935 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:20.893230 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fee6d3-3ed3-4f43-aa50-fad776a3d935 None admin] RBAC: Adding query filter params (name=service) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:20.893604 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fee6d3-3ed3-4f43-aa50-fad776a3d935 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:20.895079 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fee6d3-3ed3-4f43-aa50-fad776a3d935 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:20.897978 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:20.904004 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 294/604] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Aug 24 04:01:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:20.904843 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fee6d3-3ed3-4f43-aa50-fad776a3d935 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:20.955780 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd9367-8ff0-4574-bf88-caf928317b53 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:20.956039 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:20.992553 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e107028-9691-4f79-b775-8d4e3046b3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:20.993181 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e107028-9691-4f79-b775-8d4e3046b3e4 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:20.993450 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e107028-9691-4f79-b775-8d4e3046b3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:20.993709 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e107028-9691-4f79-b775-8d4e3046b3e4 None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:20.994332 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e107028-9691-4f79-b775-8d4e3046b3e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:20.994631 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e107028-9691-4f79-b775-8d4e3046b3e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:20.996019 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e107028-9691-4f79-b775-8d4e3046b3e4 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:21.008768 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 311/605] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 04:01:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:21.009601 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e107028-9691-4f79-b775-8d4e3046b3e4 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:21.015775 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fee6d3-3ed3-4f43-aa50-fad776a3d935 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:21.051401 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad8e01-0e35-4543-ba24-f25c288b0eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:21.052029 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad8e01-0e35-4543-ba24-f25c288b0eda None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:21.052303 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad8e01-0e35-4543-ba24-f25c288b0eda None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:21.052558 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad8e01-0e35-4543-ba24-f25c288b0eda None admin] PATH_INFO: `/v3/roles/service` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:21.064193 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ad8e01-0e35-4543-ba24-f25c288b0eda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:01:21.069688 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-42ad8e01-0e35-4543-ba24-f25c288b0eda None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:01:21.069688 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:21.069688 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:21.069688 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:21.069688 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:21.069688 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:21.069688 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:21.069688 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:21.069688 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:21.069688 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:21.069688 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:21.069688 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:21.069688 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:01:21.069688 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:01:21.069688 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:01:21.069688 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:01:21.070634 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:01:21.070634 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:01:21.070634 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:01:21.070634 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:01:21.070634 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:21.070634 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:21.070634 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:21.070634 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:21.070634 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:21.070634 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:21.070634 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:21.070634 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:21.070634 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:21.070634 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:21.070634 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:21.070634 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:21.072156 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:21.072156 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:21.072156 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:21.072156 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:21.072156 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:01:21.072156 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:01:21.072156 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:01:21.072156 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:01:21.072156 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:01:21.072156 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:01:21.072156 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:01:21.072156 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:21.072156 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 295/606] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Aug 24 04:01:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:21.072156 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad8e01-0e35-4543-ba24-f25c288b0eda None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:21.115105 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e107028-9691-4f79-b775-8d4e3046b3e4 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:21.122700 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:21.149901 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a740aea-6802-4fad-836c-7e64d68e1b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:21.150415 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a740aea-6802-4fad-836c-7e64d68e1b80 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:21.150692 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a740aea-6802-4fad-836c-7e64d68e1b80 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:21.150963 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a740aea-6802-4fad-836c-7e64d68e1b80 None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:21.151631 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a740aea-6802-4fad-836c-7e64d68e1b80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:21.151930 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a740aea-6802-4fad-836c-7e64d68e1b80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:21.153298 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a740aea-6802-4fad-836c-7e64d68e1b80 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:21.165074 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 312/607] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 04:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:21.165921 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a740aea-6802-4fad-836c-7e64d68e1b80 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:21.179971 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad8e01-0e35-4543-ba24-f25c288b0eda None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:21.182324 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:21.216538 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff847fea-1e84-479c-8401-728b8fa7c883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:21.217310 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff847fea-1e84-479c-8401-728b8fa7c883 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:21.217595 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff847fea-1e84-479c-8401-728b8fa7c883 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:21.217864 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff847fea-1e84-479c-8401-728b8fa7c883 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:21.229169 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff847fea-1e84-479c-8401-728b8fa7c883 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:21.230627 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff847fea-1e84-479c-8401-728b8fa7c883 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:21.244838 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-ff847fea-1e84-479c-8401-728b8fa7c883 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:21.244838 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:21.244838 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:21.244838 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:21.244838 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:21.244838 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:21.244838 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:21.244838 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:21.244838 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:21.244838 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:21.244838 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:21.244838 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:21.244838 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:01:21.244838 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:01:21.244838 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:01:21.244838 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:01:21.245955 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:21.245955 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:21.245955 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:21.245955 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:21.245955 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:21.245955 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:21.245955 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:21.245955 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:21.245955 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:21.245955 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:21.245955 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:21.245955 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:21.245955 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:21.245955 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:21.245955 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:21.245955 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:21.245955 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:01:21.246827 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:01:21.246827 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:21.246827 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:21.246827 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 296/608] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:01:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:21.246827 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff847fea-1e84-479c-8401-728b8fa7c883 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:21.269235 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a740aea-6802-4fad-836c-7e64d68e1b80 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:21.304172 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a7517-55f8-4ee1-8828-297474909a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:21.304841 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a7517-55f8-4ee1-8828-297474909a47 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:21.305116 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a7517-55f8-4ee1-8828-297474909a47 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:21.305384 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a7517-55f8-4ee1-8828-297474909a47 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:21.313847 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2a7517-55f8-4ee1-8828-297474909a47 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:21.315372 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2a7517-55f8-4ee1-8828-297474909a47 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:21.326805 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-ac2a7517-55f8-4ee1-8828-297474909a47 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 04:01:21.326805 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:21.326805 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:21.326805 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:21.326805 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:21.326805 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:21.326805 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:21.326805 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:21.326805 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:21.326805 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:21.326805 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:21.326805 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:21.326805 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:01:21.326805 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:01:21.326805 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:01:21.326805 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:01:21.327954 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:21.327954 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:21.327954 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:01:21.327954 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:01:21.327954 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:01:21.327954 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:01:21.327954 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:21.327954 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:21.327954 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:21.327954 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:21.327954 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:21.327954 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:21.327954 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:21.327954 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:21.327954 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:21.327954 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:21.327954 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:21.327954 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:21.329095 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:21.329095 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:21.329095 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:01:21.329095 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:01:21.329095 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:01:21.329095 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:01:21.329095 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:01:21.329095 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:01:21.329095 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 04:01:21.329095 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:21.331488 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 313/609] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 04:01:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:21.332287 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a7517-55f8-4ee1-8828-297474909a47 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:21.352347 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff847fea-1e84-479c-8401-728b8fa7c883 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:21.360108 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:21.386356 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae16761-8292-4887-b54d-7d392ebbdc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:21.387063 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae16761-8292-4887-b54d-7d392ebbdc11 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:21.387379 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae16761-8292-4887-b54d-7d392ebbdc11 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:21.387654 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae16761-8292-4887-b54d-7d392ebbdc11 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:21.388316 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae16761-8292-4887-b54d-7d392ebbdc11 None admin] RBAC: Adding query filter params (name=service) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:21.388615 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae16761-8292-4887-b54d-7d392ebbdc11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:21.390017 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae16761-8292-4887-b54d-7d392ebbdc11 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:21.398125 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 297/610] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Aug 24 04:01:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:21.399016 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae16761-8292-4887-b54d-7d392ebbdc11 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:21.419705 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:21.436761 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a7517-55f8-4ee1-8828-297474909a47 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:21.471307 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19f197-2e79-4f7e-be11-782b9a823304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:21.472185 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19f197-2e79-4f7e-be11-782b9a823304 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:21.472458 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19f197-2e79-4f7e-be11-782b9a823304 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:21.472727 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19f197-2e79-4f7e-be11-782b9a823304 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:21.479524 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f19f197-2e79-4f7e-be11-782b9a823304 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:21.480993 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f19f197-2e79-4f7e-be11-782b9a823304 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:21.491975 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-6f19f197-2e79-4f7e-be11-782b9a823304 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:01:21.491975 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:21.491975 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:21.491975 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:21.491975 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:21.491975 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:21.491975 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:21.491975 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:21.491975 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:21.491975 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:21.491975 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:21.491975 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:21.491975 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:01:21.491975 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:01:21.491975 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:01:21.493105 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:01:21.493105 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:21.493105 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:21.493105 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:21.493105 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:21.493105 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:21.493105 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:21.493105 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:21.493105 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:21.493105 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:21.493105 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:21.493105 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:21.493105 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:21.493105 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:21.493105 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:21.493105 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:21.493105 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:21.494331 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:01:21.494331 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:01:21.494331 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:01:21.494331 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:01:21.494331 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:01:21.494331 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:01:21.494331 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:01:21.494331 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:21.494331 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 314/611] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 24 04:01:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:21.494331 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19f197-2e79-4f7e-be11-782b9a823304 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:21.505707 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae16761-8292-4887-b54d-7d392ebbdc11 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:21.540272 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6498d9-3a28-4443-a6f2-1df3eca4f85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:21.540841 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6498d9-3a28-4443-a6f2-1df3eca4f85d None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:21.541118 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6498d9-3a28-4443-a6f2-1df3eca4f85d None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:21.541390 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6498d9-3a28-4443-a6f2-1df3eca4f85d None admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:21.542029 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6498d9-3a28-4443-a6f2-1df3eca4f85d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:21.542332 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6498d9-3a28-4443-a6f2-1df3eca4f85d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:21.543753 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6498d9-3a28-4443-a6f2-1df3eca4f85d None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:21.555846 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 298/612] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 04:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:21.556956 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6498d9-3a28-4443-a6f2-1df3eca4f85d None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:21.584940 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:21.604448 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19f197-2e79-4f7e-be11-782b9a823304 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:21.640871 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:21.642257 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6fd4b-9414-4981-911b-fe02397c78c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:21.643274 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6fd4b-9414-4981-911b-fe02397c78c2 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:21.643559 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6fd4b-9414-4981-911b-fe02397c78c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:21.643832 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6fd4b-9414-4981-911b-fe02397c78c2 None admin] PATH_INFO: `/v3/users` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:21.644609 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c6fd4b-9414-4981-911b-fe02397c78c2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:21.644908 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c6fd4b-9414-4981-911b-fe02397c78c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:21.646416 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c6fd4b-9414-4981-911b-fe02397c78c2 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:21.667523 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 315/613] 10.222.0.15 () {56 vars in 1137 bytes} [Wed Aug 24 04:01:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:21.667740 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6498d9-3a28-4443-a6f2-1df3eca4f85d None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:21.668389 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6fd4b-9414-4981-911b-fe02397c78c2 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:21.706514 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e3d1b-88aa-49ae-8f7f-44c2176360c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:21.707035 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e3d1b-88aa-49ae-8f7f-44c2176360c1 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:21.707341 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e3d1b-88aa-49ae-8f7f-44c2176360c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:21.707611 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e3d1b-88aa-49ae-8f7f-44c2176360c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:21.718037 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e3d1b-88aa-49ae-8f7f-44c2176360c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:21.719525 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e3d1b-88aa-49ae-8f7f-44c2176360c1 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:21.734186 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-ea1e3d1b-88aa-49ae-8f7f-44c2176360c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:21.734186 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:21.734186 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:21.734186 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:21.734186 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:21.734186 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:21.734186 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:21.734186 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:21.734186 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:21.734186 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:21.734186 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:21.734186 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:21.734186 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:01:21.734186 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:01:21.734186 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:01:21.734186 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:01:21.735373 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:21.735373 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:21.735373 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:21.735373 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:21.735373 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:21.735373 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:21.735373 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:21.735373 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:21.735373 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:21.735373 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:21.735373 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:21.735373 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:21.735373 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:21.735373 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:21.735373 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:21.735373 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:21.735373 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:01:21.736229 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:01:21.736229 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:21.736229 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:21.736229 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 299/614] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:01:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:21.736477 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e3d1b-88aa-49ae-8f7f-44c2176360c1 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:21.776994 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6fd4b-9414-4981-911b-fe02397c78c2 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:21.813991 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e849b-312c-4aca-b620-c26e06f6e54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:21.814599 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e849b-312c-4aca-b620-c26e06f6e54c None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:21.814881 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e849b-312c-4aca-b620-c26e06f6e54c None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:21.815284 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e849b-312c-4aca-b620-c26e06f6e54c None admin] PATH_INFO: `/v3/projects` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:21.815883 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202e849b-312c-4aca-b620-c26e06f6e54c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:21.816187 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202e849b-312c-4aca-b620-c26e06f6e54c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:21.817627 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202e849b-312c-4aca-b620-c26e06f6e54c None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:21.830044 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 316/615] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 24 04:01:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:21.830880 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e849b-312c-4aca-b620-c26e06f6e54c None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:21.835606 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:21.842231 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e3d1b-88aa-49ae-8f7f-44c2176360c1 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:21.871464 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:21.878026 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4712e-27a0-4b9a-a6e8-9aa089c99951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:21.878662 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4712e-27a0-4b9a-a6e8-9aa089c99951 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:21.878951 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4712e-27a0-4b9a-a6e8-9aa089c99951 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:21.879239 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4712e-27a0-4b9a-a6e8-9aa089c99951 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:21.887224 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b4712e-27a0-4b9a-a6e8-9aa089c99951 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:21.888719 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b4712e-27a0-4b9a-a6e8-9aa089c99951 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:21.903612 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-77b4712e-27a0-4b9a-a6e8-9aa089c99951 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 04:01:21.903612 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:21.903612 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:21.903612 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:21.903612 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:21.903612 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:21.903612 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:21.903612 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:21.903612 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:21.903612 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:21.903612 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:21.903612 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:21.903612 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:01:21.903612 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:01:21.903612 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:01:21.903612 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:01:21.904731 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:21.904731 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:21.904731 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:01:21.904731 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:01:21.904731 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:01:21.904731 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:01:21.904731 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:21.904731 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:21.904731 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:21.904731 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:21.904731 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:21.904731 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:21.904731 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:21.904731 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:21.904731 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:21.904731 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:21.904731 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:21.904731 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:21.905824 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:21.905824 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:21.905824 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:01:21.905824 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:01:21.905824 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:01:21.905824 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:01:21.905824 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:01:21.905824 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:01:21.905824 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 04:01:21.905824 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:21.905824 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 300/616] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 04:01:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:21.906529 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4712e-27a0-4b9a-a6e8-9aa089c99951 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:21.942935 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e849b-312c-4aca-b620-c26e06f6e54c None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:21.977842 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d74f4-0045-46a3-a54b-f6ab7f6532e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:21.978368 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d74f4-0045-46a3-a54b-f6ab7f6532e0 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:21.978650 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d74f4-0045-46a3-a54b-f6ab7f6532e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:21.978989 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d74f4-0045-46a3-a54b-f6ab7f6532e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:22.011794 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4712e-27a0-4b9a-a6e8-9aa089c99951 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:22.045368 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d649a-2963-4818-ba39-ca554d4bdbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:22.045981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d649a-2963-4818-ba39-ca554d4bdbb4 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:22.046241 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d649a-2963-4818-ba39-ca554d4bdbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:22.046499 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d649a-2963-4818-ba39-ca554d4bdbb4 None admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:22.047138 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d649a-2963-4818-ba39-ca554d4bdbb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:22.047465 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d649a-2963-4818-ba39-ca554d4bdbb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:22.048905 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d649a-2963-4818-ba39-ca554d4bdbb4 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:22.049100 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907d74f4-0045-46a3-a54b-f6ab7f6532e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:22.050567 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907d74f4-0045-46a3-a54b-f6ab7f6532e0 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:22.053266 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:22.060544 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 301/617] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 04:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:22.061359 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d649a-2963-4818-ba39-ca554d4bdbb4 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:22.116382 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:22.151932 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 317/618] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 24 04:01:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:22.152778 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d74f4-0045-46a3-a54b-f6ab7f6532e0 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:22.168364 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d649a-2963-4818-ba39-ca554d4bdbb4 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:22.203793 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951275b-6f6d-41c4-8edc-b8d265637281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:22.204398 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951275b-6f6d-41c4-8edc-b8d265637281 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:22.204678 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951275b-6f6d-41c4-8edc-b8d265637281 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:22.204946 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951275b-6f6d-41c4-8edc-b8d265637281 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:22.205672 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6951275b-6f6d-41c4-8edc-b8d265637281 None admin] RBAC: Adding query filter params (role.id=4278d3d9834d462b821b63a99db9229a, scope.project.id=5c317b3ce1d1468f95bc01ba2587e623, user.id=3796b1549762419686cb3b00af1a963e) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:22.205975 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6951275b-6f6d-41c4-8edc-b8d265637281 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:22.207446 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6951275b-6f6d-41c4-8edc-b8d265637281 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:22.213596 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 302/619] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 24 04:01:22 2022] GET /identity/v3/role_assignments?user.id=3796b1549762419686cb3b00af1a963e&scope.project.id=5c317b3ce1d1468f95bc01ba2587e623&role.id=4278d3d9834d462b821b63a99db9229a => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:22.214224 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951275b-6f6d-41c4-8edc-b8d265637281 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:22.259680 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d74f4-0045-46a3-a54b-f6ab7f6532e0 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:22.262452 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:22.307548 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8e001-bbfd-4b47-b0c4-8a7054d313d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:22.308169 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8e001-bbfd-4b47-b0c4-8a7054d313d5 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:22.308450 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8e001-bbfd-4b47-b0c4-8a7054d313d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:22.308722 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8e001-bbfd-4b47-b0c4-8a7054d313d5 None admin] PATH_INFO: `/v3/users` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:22.309495 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf8e001-bbfd-4b47-b0c4-8a7054d313d5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:22.309805 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf8e001-bbfd-4b47-b0c4-8a7054d313d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:22.311275 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf8e001-bbfd-4b47-b0c4-8a7054d313d5 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:22.335610 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 318/620] 10.222.0.15 () {56 vars in 1137 bytes} [Wed Aug 24 04:01:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:22.335610 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8e001-bbfd-4b47-b0c4-8a7054d313d5 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:22.351111 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951275b-6f6d-41c4-8edc-b8d265637281 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:22.366703 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:22.391017 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855ba72-a65b-4882-97cd-8e1bc9006b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:22.391697 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855ba72-a65b-4882-97cd-8e1bc9006b9d None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:22.391976 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855ba72-a65b-4882-97cd-8e1bc9006b9d None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:22.392246 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855ba72-a65b-4882-97cd-8e1bc9006b9d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:22.400645 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c855ba72-a65b-4882-97cd-8e1bc9006b9d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:22.402126 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c855ba72-a65b-4882-97cd-8e1bc9006b9d None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:22.415867 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-c855ba72-a65b-4882-97cd-8e1bc9006b9d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 04:01:22.415867 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:22.415867 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:22.415867 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:22.415867 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:22.415867 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:22.415867 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:22.415867 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:22.415867 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:22.415867 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:22.415867 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:22.415867 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:22.415867 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:01:22.415867 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:01:22.415867 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:01:22.415867 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:01:22.416996 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:22.416996 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:22.416996 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:01:22.416996 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:01:22.416996 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:01:22.416996 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:01:22.416996 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:22.416996 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:22.416996 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:22.416996 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:22.416996 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:22.416996 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:22.416996 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:22.416996 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:22.416996 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:22.416996 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:22.416996 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:22.416996 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:22.419481 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:22.419481 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:22.419481 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:01:22.419481 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:01:22.419481 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:01:22.419481 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:01:22.419481 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:01:22.419481 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:01:22.419481 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 04:01:22.419481 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:22.419481 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 303/621] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Aug 24 04:01:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:22.419481 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855ba72-a65b-4882-97cd-8e1bc9006b9d None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:22.450204 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8e001-bbfd-4b47-b0c4-8a7054d313d5 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:22.494176 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8df4ff-2faf-4e50-b0cd-a4f8c61559b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:22.495090 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8df4ff-2faf-4e50-b0cd-a4f8c61559b6 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:22.495456 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8df4ff-2faf-4e50-b0cd-a4f8c61559b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:22.495737 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8df4ff-2faf-4e50-b0cd-a4f8c61559b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:22.508117 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8df4ff-2faf-4e50-b0cd-a4f8c61559b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:22.509659 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8df4ff-2faf-4e50-b0cd-a4f8c61559b6 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:22.525790 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-4b8df4ff-2faf-4e50-b0cd-a4f8c61559b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:22.525790 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:22.525790 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:22.525790 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:22.525790 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:22.525790 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:22.525790 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:22.525790 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:22.525790 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:22.525790 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:22.525790 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:22.525790 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:22.525790 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:01:22.525790 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:01:22.525790 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:01:22.525790 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:01:22.526920 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:22.526920 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:22.526920 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:22.526920 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:22.526920 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:22.526920 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:22.526920 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:22.526920 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:22.526920 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:22.526920 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:22.526920 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:22.526920 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:22.526920 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:22.526920 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:22.526920 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:22.526920 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:22.526920 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:01:22.528434 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:01:22.528434 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:22.528434 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:22.528434 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 319/622] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:01:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:22.528434 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8df4ff-2faf-4e50-b0cd-a4f8c61559b6 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:22.531344 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855ba72-a65b-4882-97cd-8e1bc9006b9d None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:22.550701 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:22.567663 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effef42d-3dde-465e-947c-6df12bd8e77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:22.568277 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effef42d-3dde-465e-947c-6df12bd8e77e None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:22.568550 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effef42d-3dde-465e-947c-6df12bd8e77e None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:22.569185 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effef42d-3dde-465e-947c-6df12bd8e77e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:22.615603 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:22.640842 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8df4ff-2faf-4e50-b0cd-a4f8c61559b6 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:22.643109 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effef42d-3dde-465e-947c-6df12bd8e77e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:22.644624 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effef42d-3dde-465e-947c-6df12bd8e77e None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:22.677306 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c8df0-0fe2-408d-85bf-77bdbcc2a50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:22.678149 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c8df0-0fe2-408d-85bf-77bdbcc2a50a None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:22.678550 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c8df0-0fe2-408d-85bf-77bdbcc2a50a None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:22.678922 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c8df0-0fe2-408d-85bf-77bdbcc2a50a None admin] PATH_INFO: `/v3/users` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:22.679805 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c8df0-0fe2-408d-85bf-77bdbcc2a50a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:22.680218 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c8df0-0fe2-408d-85bf-77bdbcc2a50a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:22.681753 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c8df0-0fe2-408d-85bf-77bdbcc2a50a None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:22.700795 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 320/623] 10.222.0.15 () {56 vars in 1139 bytes} [Wed Aug 24 04:01:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:22.701765 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c8df0-0fe2-408d-85bf-77bdbcc2a50a None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:22.759564 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 304/624] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 24 04:01:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:22.761161 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effef42d-3dde-465e-947c-6df12bd8e77e None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:22.780540 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:22.812380 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c8df0-0fe2-408d-85bf-77bdbcc2a50a None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:22.852723 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:22.853571 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83443e1-fd1d-44b3-adc7-c751d9fa816b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:22.854348 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83443e1-fd1d-44b3-adc7-c751d9fa816b None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:22.854806 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83443e1-fd1d-44b3-adc7-c751d9fa816b None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:22.855370 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83443e1-fd1d-44b3-adc7-c751d9fa816b None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:22.855982 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83443e1-fd1d-44b3-adc7-c751d9fa816b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:22.856288 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83443e1-fd1d-44b3-adc7-c751d9fa816b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:22.857672 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83443e1-fd1d-44b3-adc7-c751d9fa816b None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:22.880868 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effef42d-3dde-465e-947c-6df12bd8e77e None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:22.922588 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc063e9-ae50-477d-8471-8741de7370c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:22.923348 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc063e9-ae50-477d-8471-8741de7370c8 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:22.923747 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc063e9-ae50-477d-8471-8741de7370c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:22.924367 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc063e9-ae50-477d-8471-8741de7370c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:22.998134 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 321/625] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 04:01:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:22.998134 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83443e1-fd1d-44b3-adc7-c751d9fa816b None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:23.009143 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc063e9-ae50-477d-8471-8741de7370c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:23.010698 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc063e9-ae50-477d-8471-8741de7370c8 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:23.090375 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:23.105994 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83443e1-fd1d-44b3-adc7-c751d9fa816b None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:23.126906 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 305/626] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 24 04:01:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:23.127676 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc063e9-ae50-477d-8471-8741de7370c8 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:23.137305 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:23.143838 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c873049-91ec-481d-865c-4abf9c534655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:23.144468 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c873049-91ec-481d-865c-4abf9c534655 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:23.144742 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c873049-91ec-481d-865c-4abf9c534655 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:23.145008 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c873049-91ec-481d-865c-4abf9c534655 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:23.155784 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c873049-91ec-481d-865c-4abf9c534655 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:23.157233 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c873049-91ec-481d-865c-4abf9c534655 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:23.172045 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-1c873049-91ec-481d-865c-4abf9c534655 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:23.172045 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:23.172045 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:23.172045 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:23.172045 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:23.172045 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:23.172045 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:23.172045 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:23.172045 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:23.172045 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:23.172045 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:23.172045 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:23.172045 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:01:23.172045 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:01:23.172045 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:01:23.172045 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:01:23.173005 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:23.173005 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:23.173005 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:23.173005 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:23.173005 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:23.173005 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:23.173005 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:23.173005 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:23.173005 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:23.173005 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:23.173005 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:23.173005 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:23.173005 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:23.173005 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:23.173005 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:23.173005 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:23.173005 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:01:23.173878 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:01:23.173878 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:23.173878 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:23.173878 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 322/627] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:01:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:23.173878 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c873049-91ec-481d-865c-4abf9c534655 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:23.244768 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc063e9-ae50-477d-8471-8741de7370c8 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:23.284849 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784bf85-666d-4355-bfa4-31be94fbb321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:23.285494 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784bf85-666d-4355-bfa4-31be94fbb321 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:23.285766 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784bf85-666d-4355-bfa4-31be94fbb321 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:23.286032 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784bf85-666d-4355-bfa4-31be94fbb321 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:23.294634 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c873049-91ec-481d-865c-4abf9c534655 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:23.297454 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9784bf85-666d-4355-bfa4-31be94fbb321 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:23.298945 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9784bf85-666d-4355-bfa4-31be94fbb321 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:23.311526 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-9784bf85-666d-4355-bfa4-31be94fbb321 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:01:23.311526 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:23.311526 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:23.311526 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:23.311526 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:23.311526 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:23.311526 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:23.311526 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:23.311526 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:23.311526 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:23.311526 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:23.311526 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:23.311526 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:01:23.311526 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:01:23.311526 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:01:23.312494 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:01:23.312494 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:23.312494 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:23.312494 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:23.312494 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:23.312494 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:23.312494 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:23.312494 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:23.312494 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:23.312494 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:23.312494 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:23.312494 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:23.312494 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:23.312494 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:23.312494 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:23.312494 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:23.312494 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:23.313385 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:01:23.313385 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:01:23.313385 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:01:23.313385 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:01:23.313385 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:01:23.313385 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:01:23.313385 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:01:23.313385 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:23.313385 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 306/628] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 24 04:01:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:23.314391 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784bf85-666d-4355-bfa4-31be94fbb321 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:23.343718 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c100f0-289c-45a8-9fdf-c79ba6ce4070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:23.344844 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c100f0-289c-45a8-9fdf-c79ba6ce4070 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:23.345377 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c100f0-289c-45a8-9fdf-c79ba6ce4070 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:23.345834 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c100f0-289c-45a8-9fdf-c79ba6ce4070 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:23.351956 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:23.358760 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c100f0-289c-45a8-9fdf-c79ba6ce4070 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:23.360352 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c100f0-289c-45a8-9fdf-c79ba6ce4070 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:23.377109 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-a4c100f0-289c-45a8-9fdf-c79ba6ce4070 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:23.377109 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:23.377109 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:23.377109 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:23.377109 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:23.377109 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:23.377109 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:23.377109 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:23.377109 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:23.377109 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:23.377109 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:23.377109 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:23.377109 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:01:23.377109 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:01:23.377109 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:01:23.377109 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:01:23.378385 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:23.378385 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:23.378385 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:23.378385 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:23.378385 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:23.378385 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:23.378385 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:23.378385 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:23.378385 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:23.378385 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:23.378385 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:23.378385 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:23.378385 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:23.378385 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:23.378385 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:23.378385 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:23.378385 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:01:23.379689 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:01:23.379689 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:23.379689 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:23.379689 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 323/629] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:01:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:23.379689 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c100f0-289c-45a8-9fdf-c79ba6ce4070 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:23.422455 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:23.440200 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784bf85-666d-4355-bfa4-31be94fbb321 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:23.479924 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16182ba2-4745-40b1-9150-c3486c34b223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:23.480635 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16182ba2-4745-40b1-9150-c3486c34b223 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:23.480814 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16182ba2-4745-40b1-9150-c3486c34b223 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:23.481107 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16182ba2-4745-40b1-9150-c3486c34b223 None admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:23.481800 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16182ba2-4745-40b1-9150-c3486c34b223 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:23.482099 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16182ba2-4745-40b1-9150-c3486c34b223 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:23.483555 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16182ba2-4745-40b1-9150-c3486c34b223 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:23.500917 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 307/630] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 04:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:23.500917 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16182ba2-4745-40b1-9150-c3486c34b223 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:23.506290 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c100f0-289c-45a8-9fdf-c79ba6ce4070 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:23.545898 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969450a2-c570-476f-9f9e-ad0b2030d28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:23.546715 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969450a2-c570-476f-9f9e-ad0b2030d28f None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:23.547061 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969450a2-c570-476f-9f9e-ad0b2030d28f None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:23.547535 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969450a2-c570-476f-9f9e-ad0b2030d28f None admin] PATH_INFO: `/v3/projects` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:23.548351 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969450a2-c570-476f-9f9e-ad0b2030d28f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:23.548733 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969450a2-c570-476f-9f9e-ad0b2030d28f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:23.550416 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969450a2-c570-476f-9f9e-ad0b2030d28f None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:23.565066 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 324/631] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 24 04:01:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:23.565926 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969450a2-c570-476f-9f9e-ad0b2030d28f None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:23.616701 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:23.625252 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16182ba2-4745-40b1-9150-c3486c34b223 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:23.663317 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a7e1d-bc47-47f8-be49-57106e83a4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:23.664037 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a7e1d-bc47-47f8-be49-57106e83a4f9 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:23.664370 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a7e1d-bc47-47f8-be49-57106e83a4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:23.664703 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a7e1d-bc47-47f8-be49-57106e83a4f9 None admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:23.665426 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267a7e1d-bc47-47f8-be49-57106e83a4f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:23.665725 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267a7e1d-bc47-47f8-be49-57106e83a4f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:23.667100 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267a7e1d-bc47-47f8-be49-57106e83a4f9 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:23.682013 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 308/632] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 04:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:23.683089 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a7e1d-bc47-47f8-be49-57106e83a4f9 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:23.688228 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:23.696327 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969450a2-c570-476f-9f9e-ad0b2030d28f None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:23.735406 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3113001-a1ad-4af7-ada8-8600bb9ef6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:23.736050 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3113001-a1ad-4af7-ada8-8600bb9ef6a4 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:23.736329 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3113001-a1ad-4af7-ada8-8600bb9ef6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:23.736607 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3113001-a1ad-4af7-ada8-8600bb9ef6a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:23.745336 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3113001-a1ad-4af7-ada8-8600bb9ef6a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:23.747742 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3113001-a1ad-4af7-ada8-8600bb9ef6a4 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:23.760857 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-e3113001-a1ad-4af7-ada8-8600bb9ef6a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:01:23.760857 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:23.760857 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:23.760857 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:23.760857 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:23.760857 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:23.760857 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:23.760857 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:23.760857 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:23.760857 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:23.760857 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:23.760857 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:23.760857 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:01:23.760857 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:01:23.760857 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:01:23.761842 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:01:23.761842 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:23.761842 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:23.761842 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:23.761842 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:23.761842 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:23.761842 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:23.761842 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:23.761842 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:23.761842 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:23.761842 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:23.761842 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:23.761842 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:23.761842 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:23.761842 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:23.761842 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:23.761842 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:23.762733 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:01:23.762733 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:01:23.762733 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:01:23.762733 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:01:23.762733 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:01:23.762733 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:01:23.762733 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:01:23.762733 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:23.762733 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 325/633] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 24 04:01:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:23.762733 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3113001-a1ad-4af7-ada8-8600bb9ef6a4 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:23.834699 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a7e1d-bc47-47f8-be49-57106e83a4f9 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:23.873809 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0efd76-aa8c-4f54-85cf-3f2131b6c389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:23.874305 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0efd76-aa8c-4f54-85cf-3f2131b6c389 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:23.874593 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0efd76-aa8c-4f54-85cf-3f2131b6c389 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:23.874856 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0efd76-aa8c-4f54-85cf-3f2131b6c389 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:23.875608 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0efd76-aa8c-4f54-85cf-3f2131b6c389 None admin] RBAC: Adding query filter params (role.id=4278d3d9834d462b821b63a99db9229a, scope.project.id=5c317b3ce1d1468f95bc01ba2587e623, user.id=7da73e8a2c7a4c5aafd1d3fbea603970) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:23.876019 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0efd76-aa8c-4f54-85cf-3f2131b6c389 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:23.877542 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0efd76-aa8c-4f54-85cf-3f2131b6c389 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:23.882983 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3113001-a1ad-4af7-ada8-8600bb9ef6a4 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:23.895448 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 309/634] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 24 04:01:23 2022] GET /identity/v3/role_assignments?user.id=7da73e8a2c7a4c5aafd1d3fbea603970&scope.project.id=5c317b3ce1d1468f95bc01ba2587e623&role.id=4278d3d9834d462b821b63a99db9229a => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:23.895448 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0efd76-aa8c-4f54-85cf-3f2131b6c389 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:23.917356 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:23.947927 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60506a91-08d9-45c5-a2f6-730de5a1e904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:23.948748 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60506a91-08d9-45c5-a2f6-730de5a1e904 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:23.949149 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60506a91-08d9-45c5-a2f6-730de5a1e904 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:23.949518 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60506a91-08d9-45c5-a2f6-730de5a1e904 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:23.960056 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60506a91-08d9-45c5-a2f6-730de5a1e904 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:23.962595 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60506a91-08d9-45c5-a2f6-730de5a1e904 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:23.981328 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-60506a91-08d9-45c5-a2f6-730de5a1e904 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:01:23.981328 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:23.981328 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:23.981328 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:23.981328 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:23.981328 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:23.981328 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:23.981328 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:23.981328 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:23.981328 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:23.981328 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:23.981328 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:23.981328 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:01:23.981328 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:01:23.981328 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:01:23.982441 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:01:23.982441 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:23.982441 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:23.982441 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:23.982441 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:23.982441 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:23.982441 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:23.982441 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:23.982441 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:23.982441 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:23.982441 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:23.982441 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:23.982441 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:23.982441 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:23.982441 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:23.982441 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:23.982441 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:23.983608 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:01:23.983608 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:01:23.983608 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:01:23.983608 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:01:23.983608 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:01:23.983608 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:01:23.983608 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:01:23.983608 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:23.985283 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 326/635] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 24 04:01:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:23.990903 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60506a91-08d9-45c5-a2f6-730de5a1e904 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:24.020736 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:24.036783 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0efd76-aa8c-4f54-85cf-3f2131b6c389 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:24.077670 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7e23c-058b-4f7f-97e1-510cea1191f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:24.078802 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7e23c-058b-4f7f-97e1-510cea1191f1 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:24.079177 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7e23c-058b-4f7f-97e1-510cea1191f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:24.079592 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7e23c-058b-4f7f-97e1-510cea1191f1 None admin] PATH_INFO: `/v3/projects` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:24.081244 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7e23c-058b-4f7f-97e1-510cea1191f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:24.081657 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7e23c-058b-4f7f-97e1-510cea1191f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:24.083252 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7e23c-058b-4f7f-97e1-510cea1191f1 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:24.098206 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 310/636] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 24 04:01:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:24.104566 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7e23c-058b-4f7f-97e1-510cea1191f1 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:24.116808 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60506a91-08d9-45c5-a2f6-730de5a1e904 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:24.157155 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d32771-9635-44a8-9786-b607f3562d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:24.157688 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d32771-9635-44a8-9786-b607f3562d44 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:24.157968 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d32771-9635-44a8-9786-b607f3562d44 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:24.158241 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d32771-9635-44a8-9786-b607f3562d44 None admin] PATH_INFO: `/v3/projects` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:24.158970 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d32771-9635-44a8-9786-b607f3562d44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:24.159300 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d32771-9635-44a8-9786-b607f3562d44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:24.160770 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d32771-9635-44a8-9786-b607f3562d44 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:24.174217 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 327/637] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 24 04:01:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:24.181141 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d32771-9635-44a8-9786-b607f3562d44 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:24.210367 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:24.239887 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7e23c-058b-4f7f-97e1-510cea1191f1 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:24.279440 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:24.289532 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03923ebe-7c81-4067-945a-dc30f61b947e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:24.290792 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03923ebe-7c81-4067-945a-dc30f61b947e None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:24.291318 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03923ebe-7c81-4067-945a-dc30f61b947e None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:24.291766 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03923ebe-7c81-4067-945a-dc30f61b947e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:24.292672 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03923ebe-7c81-4067-945a-dc30f61b947e None admin] RBAC: Adding query filter params (role.id=4278d3d9834d462b821b63a99db9229a, scope.project.id=5c317b3ce1d1468f95bc01ba2587e623, user.id=9d60ca48fd1b4a4ab4261ad1dbd6c8bc) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:24.293183 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03923ebe-7c81-4067-945a-dc30f61b947e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:24.295848 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03923ebe-7c81-4067-945a-dc30f61b947e None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:24.311160 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 311/638] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 24 04:01:24 2022] GET /identity/v3/role_assignments?user.id=9d60ca48fd1b4a4ab4261ad1dbd6c8bc&scope.project.id=5c317b3ce1d1468f95bc01ba2587e623&role.id=4278d3d9834d462b821b63a99db9229a => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:01:24.314438 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d32771-9635-44a8-9786-b607f3562d44 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:24.369553 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c15957-89cb-42b7-8e5f-4af604cc8199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:24.370534 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c15957-89cb-42b7-8e5f-4af604cc8199 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:24.370954 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c15957-89cb-42b7-8e5f-4af604cc8199 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:24.371389 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c15957-89cb-42b7-8e5f-4af604cc8199 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:24.372618 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c15957-89cb-42b7-8e5f-4af604cc8199 None admin] RBAC: Adding query filter params (role.id=4278d3d9834d462b821b63a99db9229a, scope.project.id=5c317b3ce1d1468f95bc01ba2587e623, user.id=e62f90d6440048e58cf530701a979e87) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:24.372932 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c15957-89cb-42b7-8e5f-4af604cc8199 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:24.374891 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c15957-89cb-42b7-8e5f-4af604cc8199 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:24.385551 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 328/639] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 24 04:01:24 2022] GET /identity/v3/role_assignments?user.id=e62f90d6440048e58cf530701a979e87&scope.project.id=5c317b3ce1d1468f95bc01ba2587e623&role.id=4278d3d9834d462b821b63a99db9229a => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:24.489203 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4bbb27-5079-4c70-818f-2b590ecd280c None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:24.489537 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4bbb27-5079-4c70-818f-2b590ecd280c None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:24.489797 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4bbb27-5079-4c70-818f-2b590ecd280c None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:24.491456 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 312/640] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:01:24.497838 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8a13f-8ac3-41da-b4d0-fa495024fbfb None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:24.498167 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8a13f-8ac3-41da-b4d0-fa495024fbfb None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:24.498390 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8a13f-8ac3-41da-b4d0-fa495024fbfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:24.519796 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-17f8a13f-8ac3-41da-b4d0-fa495024fbfb None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:01:24.521104 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-17f8a13f-8ac3-41da-b4d0-fa495024fbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:24.612337 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 329/641] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:01:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:01:24.991760 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4bbb27-5079-4c70-818f-2b590ecd280c None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:25.115145 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4bbb27-5079-4c70-818f-2b590ecd280c None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:25.161747 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd761b-835b-4bd3-a93b-a2157c61d669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:25.162390 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd761b-835b-4bd3-a93b-a2157c61d669 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:25.162670 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd761b-835b-4bd3-a93b-a2157c61d669 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:25.162989 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd761b-835b-4bd3-a93b-a2157c61d669 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:25.175585 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd761b-835b-4bd3-a93b-a2157c61d669 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:01:25.185902 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-82fd761b-835b-4bd3-a93b-a2157c61d669 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:01:25.185902 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:25.185902 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:25.185902 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:25.185902 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:25.185902 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:25.185902 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:25.185902 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:25.185902 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:25.185902 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:25.185902 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:25.185902 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:25.185902 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:01:25.185902 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:01:25.185902 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:01:25.185902 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:01:25.186911 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:01:25.186911 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:01:25.186911 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:01:25.186911 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:01:25.186911 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:25.186911 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:25.186911 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:25.186911 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:25.186911 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:25.186911 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:25.186911 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:25.186911 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:25.186911 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:25.186911 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:25.186911 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:25.186911 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:25.187855 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:25.187855 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:25.187855 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:25.187855 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:25.187855 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:01:25.187855 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:01:25.187855 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:01:25.187855 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:01:25.187855 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:01:25.187855 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:01:25.187855 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:01:25.187855 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:25.188518 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 313/642] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 24 04:01:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:25.195261 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f8a13f-8ac3-41da-b4d0-fa495024fbfb None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:25.268096 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:25.309380 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f8a13f-8ac3-41da-b4d0-fa495024fbfb None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:25.344221 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92e4e8-fa82-4ddb-b227-932bf97bb8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:25.344815 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92e4e8-fa82-4ddb-b227-932bf97bb8fb None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:25.345088 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92e4e8-fa82-4ddb-b227-932bf97bb8fb None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:25.345356 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92e4e8-fa82-4ddb-b227-932bf97bb8fb None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:25.346019 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f92e4e8-fa82-4ddb-b227-932bf97bb8fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:25.346313 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f92e4e8-fa82-4ddb-b227-932bf97bb8fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:25.347794 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f92e4e8-fa82-4ddb-b227-932bf97bb8fb None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:25.356548 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 330/643] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 04:01:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:25.362194 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd761b-835b-4bd3-a93b-a2157c61d669 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:25.365744 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:25.487310 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd761b-835b-4bd3-a93b-a2157c61d669 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:25.530774 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8248ad-b15c-4a13-b195-cd2a8d941387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:25.531434 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8248ad-b15c-4a13-b195-cd2a8d941387 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:25.531712 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8248ad-b15c-4a13-b195-cd2a8d941387 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:25.531985 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8248ad-b15c-4a13-b195-cd2a8d941387 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:25.548629 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8248ad-b15c-4a13-b195-cd2a8d941387 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:25.550463 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8248ad-b15c-4a13-b195-cd2a8d941387 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:25.569321 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-8e8248ad-b15c-4a13-b195-cd2a8d941387 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:25.569321 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:25.569321 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:25.569321 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:25.569321 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:25.569321 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:25.569321 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:25.569321 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:25.569321 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:25.569321 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:25.569321 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:25.569321 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:25.569321 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:01:25.569321 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:01:25.569321 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:01:25.569321 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:01:25.570324 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:25.570324 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:25.570324 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:25.570324 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:25.570324 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:25.570324 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:25.570324 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:25.570324 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:25.570324 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:25.570324 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:25.570324 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:25.570324 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:25.570324 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:25.570324 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:25.570324 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:25.570324 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:25.570324 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:01:25.571212 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:01:25.571212 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:25.571212 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:25.571683 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 314/644] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:01:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:25.577557 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92e4e8-fa82-4ddb-b227-932bf97bb8fb None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:25.689739 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92e4e8-fa82-4ddb-b227-932bf97bb8fb None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:25.724469 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:25.729964 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb71275-495b-4991-b930-75978519f20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:25.730576 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb71275-495b-4991-b930-75978519f20c None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:25.730859 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb71275-495b-4991-b930-75978519f20c None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:25.731135 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb71275-495b-4991-b930-75978519f20c None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:25.731818 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb71275-495b-4991-b930-75978519f20c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:25.732124 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb71275-495b-4991-b930-75978519f20c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:25.733567 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb71275-495b-4991-b930-75978519f20c None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:25.746417 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 331/645] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 04:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:25.752466 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8248ad-b15c-4a13-b195-cd2a8d941387 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:25.811804 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:25.859175 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8248ad-b15c-4a13-b195-cd2a8d941387 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:25.894072 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74850c46-6775-4ba9-bb8d-f99c91f43d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:25.894713 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74850c46-6775-4ba9-bb8d-f99c91f43d1a None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:25.894992 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74850c46-6775-4ba9-bb8d-f99c91f43d1a None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:25.895289 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74850c46-6775-4ba9-bb8d-f99c91f43d1a None admin] PATH_INFO: `/v3/users/nova` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:25.903638 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74850c46-6775-4ba9-bb8d-f99c91f43d1a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:25.905135 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74850c46-6775-4ba9-bb8d-f99c91f43d1a None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:25.917694 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-74850c46-6775-4ba9-bb8d-f99c91f43d1a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:01:25.917694 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:25.917694 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:25.917694 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:25.917694 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:25.917694 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:25.917694 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:25.917694 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:25.917694 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:25.917694 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:25.917694 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:25.917694 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:25.917694 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:01:25.917694 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:01:25.917694 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:01:25.917694 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:01:25.918932 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:25.918932 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:25.918932 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:01:25.918932 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:01:25.918932 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:01:25.918932 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:01:25.918932 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:25.918932 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:25.918932 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:25.918932 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:25.918932 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:25.918932 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:25.918932 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:25.918932 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:25.918932 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:25.918932 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:25.918932 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:25.918932 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:25.920111 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:25.920111 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:25.920111 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:01:25.920111 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:01:25.920111 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:01:25.920111 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:01:25.920111 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:01:25.920111 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:01:25.920111 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:01:25.920111 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:25.923465 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 315/646] 10.222.0.15 () {56 vars in 1093 bytes} [Wed Aug 24 04:01:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:25.928436 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb71275-495b-4991-b930-75978519f20c None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:26.040186 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb71275-495b-4991-b930-75978519f20c None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:26.078088 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922de229-71e5-4606-90ed-6f2c3dd46c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:26.078860 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922de229-71e5-4606-90ed-6f2c3dd46c40 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:26.079291 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922de229-71e5-4606-90ed-6f2c3dd46c40 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:26.079679 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922de229-71e5-4606-90ed-6f2c3dd46c40 None admin] PATH_INFO: `/v3/users` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:26.081095 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922de229-71e5-4606-90ed-6f2c3dd46c40 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:26.081552 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922de229-71e5-4606-90ed-6f2c3dd46c40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:26.083137 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922de229-71e5-4606-90ed-6f2c3dd46c40 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:26.103226 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 332/647] 10.222.0.15 () {56 vars in 1133 bytes} [Wed Aug 24 04:01:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:26.108487 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74850c46-6775-4ba9-bb8d-f99c91f43d1a None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:26.235379 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74850c46-6775-4ba9-bb8d-f99c91f43d1a None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:26.253534 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:26.280201 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd71ac39-eb5a-4449-bf35-c986e306a2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:26.280818 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71ac39-eb5a-4449-bf35-c986e306a2a9 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:26.281096 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71ac39-eb5a-4449-bf35-c986e306a2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:26.281368 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71ac39-eb5a-4449-bf35-c986e306a2a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:26.310857 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9507b-83ab-480f-854b-ea6261d5f521 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:26.311383 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9507b-83ab-480f-854b-ea6261d5f521 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:26.311383 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9507b-83ab-480f-854b-ea6261d5f521 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:26.312952 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 333/648] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:01:26.322811 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0a6b4-7089-4dd5-8c72-68163a51d456 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:26.323138 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0a6b4-7089-4dd5-8c72-68163a51d456 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:26.323399 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0a6b4-7089-4dd5-8c72-68163a51d456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:26.352263 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-0bf0a6b4-7089-4dd5-8c72-68163a51d456 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:01:26.354828 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-0bf0a6b4-7089-4dd5-8c72-68163a51d456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:26.364090 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd71ac39-eb5a-4449-bf35-c986e306a2a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:26.365679 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd71ac39-eb5a-4449-bf35-c986e306a2a9 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:26.422600 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:26.460575 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 334/649] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:01:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:01:26.495671 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 316/650] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 24 04:01:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:01:26.504335 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0a6b4-7089-4dd5-8c72-68163a51d456 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:26.644830 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0a6b4-7089-4dd5-8c72-68163a51d456 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:26.682922 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4330a6f-63eb-4c18-8ea2-df276fef3b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:26.683590 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4330a6f-63eb-4c18-8ea2-df276fef3b77 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:26.683874 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4330a6f-63eb-4c18-8ea2-df276fef3b77 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:26.684143 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4330a6f-63eb-4c18-8ea2-df276fef3b77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:26.691896 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b6961-6169-421b-a54b-fb5401ce817f None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:26.692178 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b6961-6169-421b-a54b-fb5401ce817f None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:26.692451 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b6961-6169-421b-a54b-fb5401ce817f None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:26.695857 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4330a6f-63eb-4c18-8ea2-df276fef3b77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:26.697349 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4330a6f-63eb-4c18-8ea2-df276fef3b77 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:26.698467 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 317/651] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:01:26 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:01:26.700634 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9730c7-516f-4da2-8181-3ec8f182859e None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:26.700924 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9730c7-516f-4da2-8181-3ec8f182859e None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:26.701612 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9730c7-516f-4da2-8181-3ec8f182859e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:26.715816 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-f4330a6f-63eb-4c18-8ea2-df276fef3b77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:26.715816 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:26.715816 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:26.715816 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:26.715816 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:26.715816 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:26.715816 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:26.715816 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:26.715816 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:26.715816 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:26.715816 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:26.715816 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:26.715816 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:01:26.715816 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:01:26.715816 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:01:26.715816 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:01:26.717050 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:26.717050 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:26.717050 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:26.717050 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:26.717050 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:26.717050 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:26.717050 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:26.717050 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:26.717050 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:26.717050 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:26.717050 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:26.717050 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:26.717050 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:26.717050 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:26.717050 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:26.717050 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:26.717050 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:01:26.718530 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:01:26.718530 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:26.718530 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:26.718530 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 335/652] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:01:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:26.723490 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4330a6f-63eb-4c18-8ea2-df276fef3b77 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:26.726865 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-dd9730c7-516f-4da2-8181-3ec8f182859e None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:01:26.728096 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-dd9730c7-516f-4da2-8181-3ec8f182859e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:26.739141 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:26.774298 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:26.832093 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 318/653] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:01:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:01:26.833013 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9730c7-516f-4da2-8181-3ec8f182859e None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:26.878296 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4330a6f-63eb-4c18-8ea2-df276fef3b77 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:26.947723 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7f8f0-bde6-4d42-8cc0-489d8e15756e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:26.948969 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7f8f0-bde6-4d42-8cc0-489d8e15756e None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:26.949890 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7f8f0-bde6-4d42-8cc0-489d8e15756e None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:26.950565 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7f8f0-bde6-4d42-8cc0-489d8e15756e None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:26.951442 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c7f8f0-bde6-4d42-8cc0-489d8e15756e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:26.951887 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c7f8f0-bde6-4d42-8cc0-489d8e15756e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:26.954886 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c7f8f0-bde6-4d42-8cc0-489d8e15756e None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:26.966396 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9730c7-516f-4da2-8181-3ec8f182859e None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:26.977662 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 336/654] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 04:01:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:26.983065 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7f8f0-bde6-4d42-8cc0-489d8e15756e None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:27.020127 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faef7f0-a9bd-4df8-90f0-1b9381dfc86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:27.020949 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faef7f0-a9bd-4df8-90f0-1b9381dfc86e None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:27.021309 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faef7f0-a9bd-4df8-90f0-1b9381dfc86e None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:27.021673 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faef7f0-a9bd-4df8-90f0-1b9381dfc86e None admin] PATH_INFO: `/v3/services/image` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:27.023278 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faef7f0-a9bd-4df8-90f0-1b9381dfc86e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:27.024373 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faef7f0-a9bd-4df8-90f0-1b9381dfc86e None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:27.039057 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-0faef7f0-a9bd-4df8-90f0-1b9381dfc86e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 04:01:27.039057 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:27.039057 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:01:27.039057 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:01:27.039057 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:01:27.039057 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:01:27.039057 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:01:27.039057 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:01:27.039057 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 04:01:27.039057 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:27.039057 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:01:27.039057 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:27.039057 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:27.039057 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:27.039057 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:27.039057 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:27.039057 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:27.040695 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:27.040695 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:27.040695 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:27.040695 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:27.040695 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:27.040695 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:27.040695 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:01:27.040695 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:01:27.040695 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:01:27.040695 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:01:27.040695 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:27.040695 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:27.040695 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:27.040695 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:27.040695 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:27.040695 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:27.042315 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:27.042315 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:27.042315 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:27.042315 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:27.042315 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:27.042315 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:27.042315 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:27.042315 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:27.042315 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:27.042315 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:27.042315 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:01:27.042315 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:01:27.042315 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 04:01:27.042315 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:27.042315 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 319/655] 10.222.0.15 () {56 vars in 1105 bytes} [Wed Aug 24 04:01:26 2022] GET /identity/v3/services/image => generated 86 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:27.049815 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b1e7d-b8bd-435a-a734-f35ae06ed7d0 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:27.050284 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b1e7d-b8bd-435a-a734-f35ae06ed7d0 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:27.050760 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b1e7d-b8bd-435a-a734-f35ae06ed7d0 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:27.052929 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 320/656] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:01:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:01:27.053525 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b1e7d-b8bd-435a-a734-f35ae06ed7d0 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:27.071924 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:27.102889 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:27.114205 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7f8f0-bde6-4d42-8cc0-489d8e15756e None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:27.163316 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f499989-09e9-42fa-85ea-a868e2d8ad7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:27.164315 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f499989-09e9-42fa-85ea-a868e2d8ad7f None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:27.164818 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f499989-09e9-42fa-85ea-a868e2d8ad7f None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:27.165303 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f499989-09e9-42fa-85ea-a868e2d8ad7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:27.174690 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f499989-09e9-42fa-85ea-a868e2d8ad7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:27.176502 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f499989-09e9-42fa-85ea-a868e2d8ad7f None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:27.188540 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-9f499989-09e9-42fa-85ea-a868e2d8ad7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:01:27.188540 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:27.188540 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:27.188540 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:27.188540 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:27.188540 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:27.188540 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:27.188540 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:27.188540 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:27.188540 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:27.188540 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:27.188540 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:27.188540 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:01:27.188540 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:01:27.188540 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:01:27.189883 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:01:27.189883 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:27.189883 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:27.189883 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:27.189883 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:27.189883 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:27.189883 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:27.189883 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:27.189883 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:27.189883 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:27.189883 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:27.189883 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:27.189883 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:27.189883 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:27.189883 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:27.189883 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:27.189883 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:27.191616 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:01:27.191616 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:01:27.191616 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:01:27.191616 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:01:27.191616 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:01:27.191616 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:01:27.191616 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:01:27.191616 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:27.191616 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 337/657] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 24 04:01:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:27.191616 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05896f4-dd62-4623-8138-cf4d6e8f8a4a None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:27.191616 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05896f4-dd62-4623-8138-cf4d6e8f8a4a None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:27.192615 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05896f4-dd62-4623-8138-cf4d6e8f8a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:27.208384 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b1e7d-b8bd-435a-a734-f35ae06ed7d0 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:27.209612 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-b05896f4-dd62-4623-8138-cf4d6e8f8a4a None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:01:27.210927 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-b05896f4-dd62-4623-8138-cf4d6e8f8a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:27.251788 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42304f3a-77ae-4577-8462-306c7b5e5847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:27.252403 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42304f3a-77ae-4577-8462-306c7b5e5847 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:27.252682 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42304f3a-77ae-4577-8462-306c7b5e5847 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:27.252955 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42304f3a-77ae-4577-8462-306c7b5e5847 None admin] PATH_INFO: `/v3/services` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:27.253604 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42304f3a-77ae-4577-8462-306c7b5e5847 None admin] RBAC: Adding query filter params (name=image) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:27.253906 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42304f3a-77ae-4577-8462-306c7b5e5847 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:27.255364 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42304f3a-77ae-4577-8462-306c7b5e5847 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:27.260791 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 321/658] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:01:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:27.262182 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42304f3a-77ae-4577-8462-306c7b5e5847 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:27.289860 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 338/659] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:01:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:01:27.290614 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05896f4-dd62-4623-8138-cf4d6e8f8a4a None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:27.382920 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:27.394670 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:27.405018 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05896f4-dd62-4623-8138-cf4d6e8f8a4a None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:27.448763 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90be0bf-07fa-4f03-9590-9f8596c07d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:27.449636 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90be0bf-07fa-4f03-9590-9f8596c07d1c None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:27.450100 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90be0bf-07fa-4f03-9590-9f8596c07d1c None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:27.450361 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90be0bf-07fa-4f03-9590-9f8596c07d1c None admin] PATH_INFO: `/v3/projects` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:27.451082 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90be0bf-07fa-4f03-9590-9f8596c07d1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:27.451415 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90be0bf-07fa-4f03-9590-9f8596c07d1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:27.452978 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90be0bf-07fa-4f03-9590-9f8596c07d1c None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:27.455359 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42304f3a-77ae-4577-8462-306c7b5e5847 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:27.475221 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 339/660] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 24 04:01:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:27.475221 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90be0bf-07fa-4f03-9590-9f8596c07d1c None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:27.524732 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1718f3-3205-46d6-b2b6-6ba148054de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:27.525475 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1718f3-3205-46d6-b2b6-6ba148054de7 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:27.526271 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1718f3-3205-46d6-b2b6-6ba148054de7 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:27.526627 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1718f3-3205-46d6-b2b6-6ba148054de7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:27.527845 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1718f3-3205-46d6-b2b6-6ba148054de7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:27.529140 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1718f3-3205-46d6-b2b6-6ba148054de7 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:27.545004 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-4c1718f3-3205-46d6-b2b6-6ba148054de7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 04:01:27.545004 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:27.545004 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:01:27.545004 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:01:27.545004 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:01:27.545004 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:01:27.545004 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:01:27.545004 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:01:27.545004 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 04:01:27.545004 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:27.545004 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:01:27.545004 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:27.545004 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:27.545004 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:27.545004 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:27.545004 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:27.545004 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:27.546229 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:27.546229 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:27.546229 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:27.546229 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:27.546229 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:27.546229 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:27.546229 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:01:27.546229 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:01:27.546229 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:01:27.546229 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:01:27.546229 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:27.546229 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:27.546229 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:27.546229 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:27.546229 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:27.546229 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:27.548970 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:27.548970 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:27.548970 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:27.548970 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:27.548970 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:27.548970 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:27.548970 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:27.548970 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:27.548970 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:27.548970 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:27.548970 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:01:27.548970 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:01:27.548970 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 04:01:27.548970 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:27.548970 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 322/661] 10.222.0.15 () {56 vars in 1129 bytes} [Wed Aug 24 04:01:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:27.550562 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1718f3-3205-46d6-b2b6-6ba148054de7 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:27.626392 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90be0bf-07fa-4f03-9590-9f8596c07d1c None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:27.673161 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1083b-15e0-4c84-ba9e-46e04d11702d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:27.674215 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1083b-15e0-4c84-ba9e-46e04d11702d None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:27.674696 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1083b-15e0-4c84-ba9e-46e04d11702d None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:27.675148 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1083b-15e0-4c84-ba9e-46e04d11702d None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:27.676215 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc1083b-15e0-4c84-ba9e-46e04d11702d None admin] RBAC: Adding query filter params (type=image) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:27.676719 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc1083b-15e0-4c84-ba9e-46e04d11702d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:27.679340 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc1083b-15e0-4c84-ba9e-46e04d11702d None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:27.690569 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 340/662] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:01:27 2022] GET /identity/v3/services?type=image => generated 122 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:27.691986 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1083b-15e0-4c84-ba9e-46e04d11702d None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:27.713544 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:27.756693 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1718f3-3205-46d6-b2b6-6ba148054de7 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:27.826414 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a90a7-2eb7-4fe5-ad7a-d7f48a3250c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:27.827806 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a90a7-2eb7-4fe5-ad7a-d7f48a3250c4 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:27.828471 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a90a7-2eb7-4fe5-ad7a-d7f48a3250c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:27.829155 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a90a7-2eb7-4fe5-ad7a-d7f48a3250c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:27.830585 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247a90a7-2eb7-4fe5-ad7a-d7f48a3250c4 None admin] RBAC: Adding query filter params (role.id=df6a8bb215d54f71a0b6988a9c01f5e4, scope.project.id=5c317b3ce1d1468f95bc01ba2587e623, user.id=3796b1549762419686cb3b00af1a963e) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:27.831326 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247a90a7-2eb7-4fe5-ad7a-d7f48a3250c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:27.834137 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247a90a7-2eb7-4fe5-ad7a-d7f48a3250c4 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:27.839871 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:27.845651 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 323/663] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 24 04:01:27 2022] GET /identity/v3/role_assignments?user.id=3796b1549762419686cb3b00af1a963e&scope.project.id=5c317b3ce1d1468f95bc01ba2587e623&role.id=df6a8bb215d54f71a0b6988a9c01f5e4 => generated 259 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:27.847316 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a90a7-2eb7-4fe5-ad7a-d7f48a3250c4 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:27.916560 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1083b-15e0-4c84-ba9e-46e04d11702d None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:27.991819 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251a25c-24ee-4d6e-9eb5-7791144a3eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:27.993087 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251a25c-24ee-4d6e-9eb5-7791144a3eaa None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:27.993877 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251a25c-24ee-4d6e-9eb5-7791144a3eaa None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:27.994484 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251a25c-24ee-4d6e-9eb5-7791144a3eaa None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:27.995862 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5251a25c-24ee-4d6e-9eb5-7791144a3eaa None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:27.996554 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5251a25c-24ee-4d6e-9eb5-7791144a3eaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:28.000856 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5251a25c-24ee-4d6e-9eb5-7791144a3eaa None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:28.010437 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 341/664] 10.222.0.15 () {56 vars in 1124 bytes} [Wed Aug 24 04:01:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:28.020493 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251a25c-24ee-4d6e-9eb5-7791144a3eaa None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:28.037625 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a90a7-2eb7-4fe5-ad7a-d7f48a3250c4 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:28.099125 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692cfdf0-3206-4c14-b9df-b3f4ee1d78de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:28.100246 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cfdf0-3206-4c14-b9df-b3f4ee1d78de None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:28.100720 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cfdf0-3206-4c14-b9df-b3f4ee1d78de None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:28.101184 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cfdf0-3206-4c14-b9df-b3f4ee1d78de None admin] PATH_INFO: `/v3/services/network` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:28.102367 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692cfdf0-3206-4c14-b9df-b3f4ee1d78de None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:28.105005 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692cfdf0-3206-4c14-b9df-b3f4ee1d78de None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:28.122493 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-692cfdf0-3206-4c14-b9df-b3f4ee1d78de None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 04:01:28.122493 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:28.122493 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:01:28.122493 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:01:28.122493 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:01:28.122493 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:01:28.122493 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:01:28.122493 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:01:28.122493 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 04:01:28.122493 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:28.122493 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:01:28.122493 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:28.122493 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:28.122493 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:28.122493 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:28.122493 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:28.122493 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:28.131660 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:28.131660 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:28.131660 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:28.131660 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:28.131660 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:28.131660 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:28.131660 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:01:28.131660 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:01:28.131660 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:01:28.131660 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:01:28.131660 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:28.131660 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:28.131660 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:28.131660 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:28.131660 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:28.131660 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:28.134161 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:28.134161 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:28.134161 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:28.134161 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:28.134161 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:28.134161 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:28.134161 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:28.134161 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:28.134161 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:28.134161 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:28.134161 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:01:28.134161 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:01:28.134161 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 04:01:28.134161 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:28.134161 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 324/665] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 24 04:01:27 2022] GET /identity/v3/services/network => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:28.138818 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692cfdf0-3206-4c14-b9df-b3f4ee1d78de None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:28.165058 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:28.207883 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251a25c-24ee-4d6e-9eb5-7791144a3eaa None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:28.255218 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef27107-9f2c-4725-bd1e-e4acc6bbbcea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:28.255965 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef27107-9f2c-4725-bd1e-e4acc6bbbcea None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:28.256377 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef27107-9f2c-4725-bd1e-e4acc6bbbcea None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:28.256751 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef27107-9f2c-4725-bd1e-e4acc6bbbcea None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:28.257546 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef27107-9f2c-4725-bd1e-e4acc6bbbcea None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:28.257957 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef27107-9f2c-4725-bd1e-e4acc6bbbcea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:28.259564 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef27107-9f2c-4725-bd1e-e4acc6bbbcea None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:28.265644 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 342/666] 10.222.0.15 () {56 vars in 1124 bytes} [Wed Aug 24 04:01:28 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:28.294346 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:28.345916 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692cfdf0-3206-4c14-b9df-b3f4ee1d78de None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:28.388181 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e2842b-f920-442f-882a-f5a41e97d8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:28.388859 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e2842b-f920-442f-882a-f5a41e97d8e9 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:28.389149 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e2842b-f920-442f-882a-f5a41e97d8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:28.389426 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e2842b-f920-442f-882a-f5a41e97d8e9 None admin] PATH_INFO: `/v3/services` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:28.390084 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e2842b-f920-442f-882a-f5a41e97d8e9 None admin] RBAC: Adding query filter params (name=network) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:28.390389 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e2842b-f920-442f-882a-f5a41e97d8e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:28.391863 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e2842b-f920-442f-882a-f5a41e97d8e9 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:28.397884 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 325/667] 10.222.0.15 () {56 vars in 1112 bytes} [Wed Aug 24 04:01:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:01:28.407173 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef27107-9f2c-4725-bd1e-e4acc6bbbcea None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:28.620417 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef27107-9f2c-4725-bd1e-e4acc6bbbcea None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:28.681837 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0703ed-c866-4de3-8cff-58f4fd18cbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:28.682883 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0703ed-c866-4de3-8cff-58f4fd18cbea None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:28.683403 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0703ed-c866-4de3-8cff-58f4fd18cbea None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:28.683860 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0703ed-c866-4de3-8cff-58f4fd18cbea None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:28.685036 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0703ed-c866-4de3-8cff-58f4fd18cbea None admin] RBAC: Adding query filter params (type=network) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:28.685570 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0703ed-c866-4de3-8cff-58f4fd18cbea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:28.688216 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0703ed-c866-4de3-8cff-58f4fd18cbea None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:28.690705 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:28.698582 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 343/668] 10.222.0.15 () {56 vars in 1112 bytes} [Wed Aug 24 04:01:28 2022] GET /identity/v3/services?type=network => generated 124 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:01:30.719783 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf924d12-4558-4bfc-b13a-b2083739031a None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:30.720567 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf924d12-4558-4bfc-b13a-b2083739031a None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:30.720567 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf924d12-4558-4bfc-b13a-b2083739031a None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:30.721939 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 326/669] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:01:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:01:30.727517 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012472f2-bf9d-4c46-bb55-95cbd27b5366 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:30.728213 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012472f2-bf9d-4c46-bb55-95cbd27b5366 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:30.728213 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012472f2-bf9d-4c46-bb55-95cbd27b5366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:30.747497 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-012472f2-bf9d-4c46-bb55-95cbd27b5366 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:01:30.748804 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-012472f2-bf9d-4c46-bb55-95cbd27b5366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:30.823089 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 344/670] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:01:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:01:31.189892 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9fac12-e355-408f-836d-0a361cf5f1d1 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:31.190359 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9fac12-e355-408f-836d-0a361cf5f1d1 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:31.190824 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9fac12-e355-408f-836d-0a361cf5f1d1 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:31.194145 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 327/671] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:01:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:01:31.203703 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07cfdf-f3d2-453b-b9be-0684d604d93a None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:31.204040 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07cfdf-f3d2-453b-b9be-0684d604d93a None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:31.204264 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07cfdf-f3d2-453b-b9be-0684d604d93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:31.226213 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-6e07cfdf-f3d2-453b-b9be-0684d604d93a None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:01:31.227534 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-6e07cfdf-f3d2-453b-b9be-0684d604d93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:31.266561 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2393e-fe53-413d-b8cb-b9cbc1d3001d None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:31.267358 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2393e-fe53-413d-b8cb-b9cbc1d3001d None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:31.267913 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2393e-fe53-413d-b8cb-b9cbc1d3001d None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:31.271651 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 328/672] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:01:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:01:31.277081 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468a595-3b3a-47a2-8793-1f984291b9b6 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:31.277746 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468a595-3b3a-47a2-8793-1f984291b9b6 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:31.278321 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468a595-3b3a-47a2-8793-1f984291b9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:31.300752 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-c468a595-3b3a-47a2-8793-1f984291b9b6 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:01:31.304077 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-c468a595-3b3a-47a2-8793-1f984291b9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:31.336499 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 345/673] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:01:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:01:31.337374 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e07cfdf-f3d2-453b-b9be-0684d604d93a None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:31.409220 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 329/674] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:01:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:01:31.411345 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935cb200-5cb7-410a-9874-620287178573 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:31.411829 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935cb200-5cb7-410a-9874-620287178573 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:31.412412 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935cb200-5cb7-410a-9874-620287178573 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:31.414162 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 330/675] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:01:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:01:31.420624 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91521ecd-2d7a-4ccc-9f7c-2379a1ab4c81 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:31.420969 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91521ecd-2d7a-4ccc-9f7c-2379a1ab4c81 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:31.421277 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91521ecd-2d7a-4ccc-9f7c-2379a1ab4c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:31.444614 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:31.446158 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-91521ecd-2d7a-4ccc-9f7c-2379a1ab4c81 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:01:31.447841 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-91521ecd-2d7a-4ccc-9f7c-2379a1ab4c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:31.494221 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e07cfdf-f3d2-453b-b9be-0684d604d93a None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:31.516808 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:31.539746 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 331/676] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:01:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:01:31.543120 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d328566d-5feb-4230-86ed-c78d9965f2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:31.543842 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328566d-5feb-4230-86ed-c78d9965f2c4 None admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:31.544120 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328566d-5feb-4230-86ed-c78d9965f2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:31.544389 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328566d-5feb-4230-86ed-c78d9965f2c4 None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:31.545119 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d328566d-5feb-4230-86ed-c78d9965f2c4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:31.546576 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d328566d-5feb-4230-86ed-c78d9965f2c4 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:31.566144 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 346/677] 10.222.0.15 () {60 vars in 1141 bytes} [Wed Aug 24 04:01:31 2022] POST /identity/v3/services => generated 242 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:01:31.672470 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91521ecd-2d7a-4ccc-9f7c-2379a1ab4c81 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:31.814994 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91521ecd-2d7a-4ccc-9f7c-2379a1ab4c81 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:31.874841 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe900539-5d92-40ec-b335-ddb294f141b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:31.875930 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe900539-5d92-40ec-b335-ddb294f141b1 None admin] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:31.876429 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe900539-5d92-40ec-b335-ddb294f141b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:31.876923 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe900539-5d92-40ec-b335-ddb294f141b1 None admin] PATH_INFO: `/v3/services` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:31.878091 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe900539-5d92-40ec-b335-ddb294f141b1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:31.880547 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe900539-5d92-40ec-b335-ddb294f141b1 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:31.898052 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d328566d-5feb-4230-86ed-c78d9965f2c4 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:31.911426 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 332/678] 10.222.0.15 () {60 vars in 1141 bytes} [Wed Aug 24 04:01:31 2022] POST /identity/v3/services => generated 251 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:01:31.913479 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe900539-5d92-40ec-b335-ddb294f141b1 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:31.993522 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:32.049749 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d328566d-5feb-4230-86ed-c78d9965f2c4 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:32.075329 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:32.075946 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe900539-5d92-40ec-b335-ddb294f141b1 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:32.101357 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea50ef5-92cc-4232-8d01-b3b71273d0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:32.102185 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea50ef5-92cc-4232-8d01-b3b71273d0ae None admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:32.102481 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea50ef5-92cc-4232-8d01-b3b71273d0ae None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:32.102761 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea50ef5-92cc-4232-8d01-b3b71273d0ae None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:32.103853 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea50ef5-92cc-4232-8d01-b3b71273d0ae None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:32.106001 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea50ef5-92cc-4232-8d01-b3b71273d0ae None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:32.127697 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 347/679] 10.222.0.15 () {60 vars in 1141 bytes} [Wed Aug 24 04:01:31 2022] POST /identity/v3/services => generated 240 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:01:32.146544 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4cca00-01a5-48b9-8e4f-08d8624f3033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:32.148045 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cca00-01a5-48b9-8e4f-08d8624f3033 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:32.148735 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cca00-01a5-48b9-8e4f-08d8624f3033 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:32.149373 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cca00-01a5-48b9-8e4f-08d8624f3033 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:32.165473 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4cca00-01a5-48b9-8e4f-08d8624f3033 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:01:32.172618 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-da4cca00-01a5-48b9-8e4f-08d8624f3033 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:01:32.172618 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:32.172618 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:32.172618 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:32.172618 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:32.172618 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:32.172618 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:32.172618 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:32.172618 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:32.172618 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:32.172618 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:32.172618 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:32.172618 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:01:32.172618 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:01:32.172618 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:01:32.172618 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:01:32.173833 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:01:32.173833 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:01:32.173833 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:01:32.173833 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:01:32.173833 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:32.173833 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:32.173833 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:32.173833 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:32.173833 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:32.173833 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:32.173833 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:32.173833 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:32.173833 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:32.173833 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:32.173833 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:32.173833 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:32.174734 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:32.174734 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:32.174734 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:32.174734 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:32.174734 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:01:32.174734 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:01:32.174734 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:01:32.174734 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:01:32.174734 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:01:32.174734 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:01:32.174734 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:01:32.174734 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:32.175542 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 333/680] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 24 04:01:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:01:32.182905 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea50ef5-92cc-4232-8d01-b3b71273d0ae None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:32.390322 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea50ef5-92cc-4232-8d01-b3b71273d0ae None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:32.459270 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181a998-ce4b-40af-ba46-62d2f682a79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:32.460311 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181a998-ce4b-40af-ba46-62d2f682a79c None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:32.460799 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181a998-ce4b-40af-ba46-62d2f682a79c None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:32.461283 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181a998-ce4b-40af-ba46-62d2f682a79c None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:32.462489 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a181a998-ce4b-40af-ba46-62d2f682a79c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:32.463106 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a181a998-ce4b-40af-ba46-62d2f682a79c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:32.465700 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a181a998-ce4b-40af-ba46-62d2f682a79c None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:32.483557 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 348/681] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 04:01:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:01:32.489163 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4cca00-01a5-48b9-8e4f-08d8624f3033 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:32.604634 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:32.614397 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4cca00-01a5-48b9-8e4f-08d8624f3033 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:32.654732 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7620802-cc2b-414d-8804-cca1d3e326c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:32.655855 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7620802-cc2b-414d-8804-cca1d3e326c2 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:32.656354 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7620802-cc2b-414d-8804-cca1d3e326c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:32.656816 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7620802-cc2b-414d-8804-cca1d3e326c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:32.671037 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7620802-cc2b-414d-8804-cca1d3e326c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:32.673142 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7620802-cc2b-414d-8804-cca1d3e326c2 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:32.690603 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-c7620802-cc2b-414d-8804-cca1d3e326c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:32.690603 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:32.690603 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:32.690603 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:32.690603 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:32.690603 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:32.690603 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:32.690603 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:32.690603 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:32.690603 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:32.690603 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:32.690603 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:32.690603 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:01:32.690603 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:01:32.690603 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:01:32.690603 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:01:32.691609 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:32.691609 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:32.691609 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:32.691609 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:32.691609 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:32.691609 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:32.691609 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:32.691609 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:32.691609 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:32.691609 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:32.691609 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:32.691609 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:32.691609 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:32.691609 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:32.691609 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:32.691609 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:32.691609 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:01:32.692489 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:01:32.692489 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:32.692489 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:32.695125 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 334/682] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:01:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:32.704705 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181a998-ce4b-40af-ba46-62d2f682a79c None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:32.762255 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:32.861051 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181a998-ce4b-40af-ba46-62d2f682a79c None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:32.912380 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4034723-2423-4f2e-bf98-d7af675cebd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:32.913514 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4034723-2423-4f2e-bf98-d7af675cebd7 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:32.913804 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4034723-2423-4f2e-bf98-d7af675cebd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:32.914130 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4034723-2423-4f2e-bf98-d7af675cebd7 None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:32.915119 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4034723-2423-4f2e-bf98-d7af675cebd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:32.915673 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4034723-2423-4f2e-bf98-d7af675cebd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:32.917662 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4034723-2423-4f2e-bf98-d7af675cebd7 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:32.937203 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 349/683] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 04:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:32.942938 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7620802-cc2b-414d-8804-cca1d3e326c2 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:33.117089 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7620802-cc2b-414d-8804-cca1d3e326c2 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:33.190833 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969a2c0-6cd9-469f-ac14-9f337d8047c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:33.191673 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969a2c0-6cd9-469f-ac14-9f337d8047c9 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:33.192149 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969a2c0-6cd9-469f-ac14-9f337d8047c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:33.192559 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969a2c0-6cd9-469f-ac14-9f337d8047c9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:33.206499 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969a2c0-6cd9-469f-ac14-9f337d8047c9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:33.209209 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969a2c0-6cd9-469f-ac14-9f337d8047c9 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:33.232900 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-b969a2c0-6cd9-469f-ac14-9f337d8047c9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:01:33.232900 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:33.232900 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:33.232900 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:33.232900 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:33.232900 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:33.232900 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:33.232900 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:33.232900 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:33.232900 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:33.232900 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:33.232900 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:33.232900 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:01:33.232900 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:01:33.232900 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:01:33.232900 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:01:33.234012 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:33.234012 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:33.234012 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:01:33.234012 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:01:33.234012 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:01:33.234012 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:01:33.234012 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:33.234012 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:33.234012 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:33.234012 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:33.234012 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:33.234012 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:33.234012 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:33.234012 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:33.234012 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:33.234012 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:33.234012 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:33.234012 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:33.235014 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:33.235014 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:33.235014 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:01:33.235014 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:01:33.235014 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:01:33.235014 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:01:33.235014 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:01:33.235014 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:01:33.235014 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:01:33.235014 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:33.235567 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 335/684] 10.222.0.15 () {56 vars in 1093 bytes} [Wed Aug 24 04:01:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:33.242043 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4034723-2423-4f2e-bf98-d7af675cebd7 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:33.385750 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:33.392052 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4034723-2423-4f2e-bf98-d7af675cebd7 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:33.447944 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7355c0-7cdd-4bdb-9e7c-d565bea3b6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:33.448480 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7355c0-7cdd-4bdb-9e7c-d565bea3b6cb None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:33.448762 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7355c0-7cdd-4bdb-9e7c-d565bea3b6cb None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:33.449037 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7355c0-7cdd-4bdb-9e7c-d565bea3b6cb None admin] PATH_INFO: `/v3/users` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:33.449930 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7355c0-7cdd-4bdb-9e7c-d565bea3b6cb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:33.450275 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7355c0-7cdd-4bdb-9e7c-d565bea3b6cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:33.451777 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7355c0-7cdd-4bdb-9e7c-d565bea3b6cb None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:33.474209 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 350/685] 10.222.0.15 () {56 vars in 1133 bytes} [Wed Aug 24 04:01:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:33.482825 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969a2c0-6cd9-469f-ac14-9f337d8047c9 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:33.503759 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:33.668356 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969a2c0-6cd9-469f-ac14-9f337d8047c9 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:33.733065 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8cae0-6375-4642-bce6-9859daecd8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:33.734062 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8cae0-6375-4642-bce6-9859daecd8d8 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:33.734733 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8cae0-6375-4642-bce6-9859daecd8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:33.735310 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8cae0-6375-4642-bce6-9859daecd8d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:33.758232 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a8cae0-6375-4642-bce6-9859daecd8d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:33.760667 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a8cae0-6375-4642-bce6-9859daecd8d8 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:33.791708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-91a8cae0-6375-4642-bce6-9859daecd8d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:33.791708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:33.791708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:33.791708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:33.791708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:33.791708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:33.791708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:33.791708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:33.791708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:33.791708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:33.791708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:33.791708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:33.791708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:01:33.791708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:01:33.791708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:01:33.791708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:01:33.792702 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:33.792702 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:33.792702 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:33.792702 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:33.792702 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:33.792702 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:33.792702 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:33.792702 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:33.792702 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:33.792702 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:33.792702 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:33.792702 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:33.792702 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:33.792702 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:33.792702 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:33.792702 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:33.792702 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:01:33.793610 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:01:33.793610 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:33.793610 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:33.794229 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 336/686] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:01:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:33.801286 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7355c0-7cdd-4bdb-9e7c-d565bea3b6cb None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:33.960495 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7355c0-7cdd-4bdb-9e7c-d565bea3b6cb None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:34.001970 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6536d35-d747-4204-91a2-dff3db84a7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:34.002585 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6536d35-d747-4204-91a2-dff3db84a7e6 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:34.002868 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6536d35-d747-4204-91a2-dff3db84a7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:34.003141 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6536d35-d747-4204-91a2-dff3db84a7e6 None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:34.003835 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6536d35-d747-4204-91a2-dff3db84a7e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:34.004141 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6536d35-d747-4204-91a2-dff3db84a7e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:34.005895 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6536d35-d747-4204-91a2-dff3db84a7e6 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:34.021197 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 351/687] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 04:01:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:34.027426 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8cae0-6375-4642-bce6-9859daecd8d8 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:34.118532 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:34.189475 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8cae0-6375-4642-bce6-9859daecd8d8 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:34.250174 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4a82b-0c39-4861-9875-3423823a3c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:34.251089 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4a82b-0c39-4861-9875-3423823a3c98 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:34.251523 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4a82b-0c39-4861-9875-3423823a3c98 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:34.251918 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4a82b-0c39-4861-9875-3423823a3c98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:34.263695 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4a82b-0c39-4861-9875-3423823a3c98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:34.266195 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4a82b-0c39-4861-9875-3423823a3c98 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:34.289009 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-61c4a82b-0c39-4861-9875-3423823a3c98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:01:34.289009 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:34.289009 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:34.289009 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:34.289009 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:34.289009 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:34.289009 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:34.289009 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:34.289009 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:34.289009 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:34.289009 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:34.289009 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:34.289009 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:01:34.289009 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:01:34.289009 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:01:34.289981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:01:34.289981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:34.289981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:34.289981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:34.289981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:34.289981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:34.289981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:34.289981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:34.289981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:34.289981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:34.289981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:34.289981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:34.289981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:34.289981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:34.289981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:34.289981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:34.289981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:34.290888 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:01:34.290888 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:01:34.290888 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:01:34.290888 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:01:34.290888 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:01:34.290888 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:01:34.290888 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:01:34.290888 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:34.291921 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 337/688] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 24 04:01:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:01:34.298509 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6536d35-d747-4204-91a2-dff3db84a7e6 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:34.323595 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:34.426242 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6536d35-d747-4204-91a2-dff3db84a7e6 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:34.469850 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602a451-5e8c-4359-affc-6b128d96898a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:34.471045 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602a451-5e8c-4359-affc-6b128d96898a None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:34.471550 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602a451-5e8c-4359-affc-6b128d96898a None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:34.472015 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602a451-5e8c-4359-affc-6b128d96898a None admin] PATH_INFO: `/v3/projects` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:34.472990 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3602a451-5e8c-4359-affc-6b128d96898a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:34.473496 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3602a451-5e8c-4359-affc-6b128d96898a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:34.475343 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3602a451-5e8c-4359-affc-6b128d96898a None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:34.490347 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 352/689] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 24 04:01:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:34.497951 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4a82b-0c39-4861-9875-3423823a3c98 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:34.499421 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3386a5-c1a9-4c99-bc3a-0a54afc9edf0 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:34.499729 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3386a5-c1a9-4c99-bc3a-0a54afc9edf0 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:34.499993 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3386a5-c1a9-4c99-bc3a-0a54afc9edf0 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:34.501803 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 353/690] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:01:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:01:34.507943 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b75ec2-3978-4891-9c0f-1656aa59e907 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:34.508345 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b75ec2-3978-4891-9c0f-1656aa59e907 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:34.508630 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b75ec2-3978-4891-9c0f-1656aa59e907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:34.528354 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-04b75ec2-3978-4891-9c0f-1656aa59e907 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:01:34.529520 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-04b75ec2-3978-4891-9c0f-1656aa59e907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:34.626613 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 354/691] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:01:34 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:01:34.626841 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4a82b-0c39-4861-9875-3423823a3c98 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:34.656071 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:34.674900 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b5141-dab6-4b20-b44f-4b0c6d90fe26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:34.676017 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b5141-dab6-4b20-b44f-4b0c6d90fe26 None admin] REQUEST_METHOD: `PUT` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:34.676500 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b5141-dab6-4b20-b44f-4b0c6d90fe26 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:34.676965 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b5141-dab6-4b20-b44f-4b0c6d90fe26 None admin] PATH_INFO: `/v3/projects/5c317b3ce1d1468f95bc01ba2587e623/users/3796b1549762419686cb3b00af1a963e/roles/df6a8bb215d54f71a0b6988a9c01f5e4` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:34.679381 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b5141-dab6-4b20-b44f-4b0c6d90fe26 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c317b3ce1d1468f95bc01ba2587e623, user_id=3796b1549762419686cb3b00af1a963e, role_id=df6a8bb215d54f71a0b6988a9c01f5e4)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:34.681191 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b5141-dab6-4b20-b44f-4b0c6d90fe26 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:34.703563 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 338/692] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Aug 24 04:01:34 2022] PUT /identity/v3/projects/5c317b3ce1d1468f95bc01ba2587e623/users/3796b1549762419686cb3b00af1a963e/roles/df6a8bb215d54f71a0b6988a9c01f5e4 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:01:34.938353 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4b1da-f65d-489d-a86f-888b0d40b1f5 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:34.939083 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4b1da-f65d-489d-a86f-888b0d40b1f5 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:34.939642 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4b1da-f65d-489d-a86f-888b0d40b1f5 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:34.941694 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 355/693] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:01:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:01:34.949408 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0326d4-0e2f-43a9-bcae-6c4cc40c5a1a None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:34.950057 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0326d4-0e2f-43a9-bcae-6c4cc40c5a1a None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:34.950550 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0326d4-0e2f-43a9-bcae-6c4cc40c5a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:34.972210 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-2e0326d4-0e2f-43a9-bcae-6c4cc40c5a1a None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:01:34.973464 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-2e0326d4-0e2f-43a9-bcae-6c4cc40c5a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:34.991300 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4b1da-f65d-489d-a86f-888b0d40b1f5 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:35.006061 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:35.064799 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 339/694] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:01:34 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:01:35.136343 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4b1da-f65d-489d-a86f-888b0d40b1f5 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:35.189260 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa7073-d1e6-4084-8dde-af44744a8c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:35.190724 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa7073-d1e6-4084-8dde-af44744a8c3e None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:35.191438 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa7073-d1e6-4084-8dde-af44744a8c3e None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:35.192112 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa7073-d1e6-4084-8dde-af44744a8c3e None admin] PATH_INFO: `/v3/services/image` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:35.194040 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa7073-d1e6-4084-8dde-af44744a8c3e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:35.197124 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa7073-d1e6-4084-8dde-af44744a8c3e None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:35.216941 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-c2fa7073-d1e6-4084-8dde-af44744a8c3e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 04:01:35.216941 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:35.216941 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:01:35.216941 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:01:35.216941 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:01:35.216941 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:01:35.216941 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:01:35.216941 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:01:35.216941 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 04:01:35.216941 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:35.216941 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:01:35.216941 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:35.216941 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:35.216941 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:35.216941 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:35.216941 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:35.216941 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:35.219179 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:35.219179 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:35.219179 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:35.219179 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:35.219179 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:35.219179 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:35.219179 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:01:35.219179 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:01:35.219179 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:01:35.219179 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:01:35.219179 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:35.219179 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:35.219179 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:35.219179 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:35.219179 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:35.219179 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:35.220942 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:35.220942 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:35.220942 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:35.220942 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:35.220942 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:35.220942 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:35.220942 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:35.220942 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:35.220942 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:35.220942 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:35.220942 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:01:35.220942 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:01:35.220942 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 04:01:35.220942 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:35.225221 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 356/695] 10.222.0.15 () {56 vars in 1105 bytes} [Wed Aug 24 04:01:34 2022] GET /identity/v3/services/image => generated 86 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:01:35.232763 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0326d4-0e2f-43a9-bcae-6c4cc40c5a1a None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:35.361187 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0326d4-0e2f-43a9-bcae-6c4cc40c5a1a None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:35.374574 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:35.403637 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9bc94-2546-457e-9550-0c7093f6cfac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:35.404265 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9bc94-2546-457e-9550-0c7093f6cfac None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:35.404596 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9bc94-2546-457e-9550-0c7093f6cfac None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:35.404838 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9bc94-2546-457e-9550-0c7093f6cfac None admin] PATH_INFO: `/v3/services` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:35.405472 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9bc94-2546-457e-9550-0c7093f6cfac None admin] RBAC: Adding query filter params (name=image) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:35.405771 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9bc94-2546-457e-9550-0c7093f6cfac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:35.407276 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9bc94-2546-457e-9550-0c7093f6cfac None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:35.413158 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 340/696] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:01:35 2022] GET /identity/v3/services?name=image => generated 122 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:35.419113 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa7073-d1e6-4084-8dde-af44744a8c3e None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:35.481132 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb9ee5-2ddb-49e0-a142-7471773f72fd None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:35.481508 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb9ee5-2ddb-49e0-a142-7471773f72fd None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:35.481811 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb9ee5-2ddb-49e0-a142-7471773f72fd None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:35.483955 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 341/697] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:01:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:01:35.493285 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f71a3-53eb-4d7d-850b-4b8dfa256866 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:35.494107 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f71a3-53eb-4d7d-850b-4b8dfa256866 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:35.494751 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f71a3-53eb-4d7d-850b-4b8dfa256866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:35.519049 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-314f71a3-53eb-4d7d-850b-4b8dfa256866 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:01:35.519913 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:35.521742 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-314f71a3-53eb-4d7d-850b-4b8dfa256866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:35.562431 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa7073-d1e6-4084-8dde-af44744a8c3e None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:35.606921 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81872b-81d9-4b23-a455-9a6698f7741b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:35.607578 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81872b-81d9-4b23-a455-9a6698f7741b None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:35.613694 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81872b-81d9-4b23-a455-9a6698f7741b None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:35.613933 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 342/698] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:01:35 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:01:35.614018 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81872b-81d9-4b23-a455-9a6698f7741b None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:35.614018 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc81872b-81d9-4b23-a455-9a6698f7741b None admin] RBAC: Adding query filter params (type=image) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:35.614144 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f71a3-53eb-4d7d-850b-4b8dfa256866 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:35.614212 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc81872b-81d9-4b23-a455-9a6698f7741b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:35.614212 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc81872b-81d9-4b23-a455-9a6698f7741b None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:35.621149 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 357/699] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:01:35 2022] GET /identity/v3/services?type=image => generated 350 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:35.626421 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81872b-81d9-4b23-a455-9a6698f7741b None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:35.758884 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81872b-81d9-4b23-a455-9a6698f7741b None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:35.771460 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f71a3-53eb-4d7d-850b-4b8dfa256866 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:35.776737 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:35.811094 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1caa6-1d05-4eb9-814f-7388bdd61603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:35.812268 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1caa6-1d05-4eb9-814f-7388bdd61603 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:35.812744 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1caa6-1d05-4eb9-814f-7388bdd61603 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:35.813204 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1caa6-1d05-4eb9-814f-7388bdd61603 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:35.814265 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe1caa6-1d05-4eb9-814f-7388bdd61603 None admin] RBAC: Adding query filter params (interface=public, service_id=960e9dff19c64bd0a9456c028aa7cd2f, region_id=RegionOne) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:35.814768 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe1caa6-1d05-4eb9-814f-7388bdd61603 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:35.816707 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe1caa6-1d05-4eb9-814f-7388bdd61603 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:35.824097 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:35.828823 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 358/700] 10.222.0.15 () {56 vars in 1251 bytes} [Wed Aug 24 04:01:35 2022] GET /identity/v3/endpoints?service_id=960e9dff19c64bd0a9456c028aa7cd2f&interface=public®ion_id=RegionOne => generated 194 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:35.834777 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1caa6-1d05-4eb9-814f-7388bdd61603 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:35.843085 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbdb97c-1eef-4b9c-a14d-350c6bbcbace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:35.844474 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdb97c-1eef-4b9c-a14d-350c6bbcbace None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:35.845091 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdb97c-1eef-4b9c-a14d-350c6bbcbace None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:35.845675 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbdb97c-1eef-4b9c-a14d-350c6bbcbace None admin] PATH_INFO: `/v3/services/network` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:35.846867 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbdb97c-1eef-4b9c-a14d-350c6bbcbace None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:35.849672 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbdb97c-1eef-4b9c-a14d-350c6bbcbace None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:35.866977 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-adbdb97c-1eef-4b9c-a14d-350c6bbcbace None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 04:01:35.866977 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:35.866977 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:01:35.866977 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:01:35.866977 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:01:35.866977 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:01:35.866977 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:01:35.866977 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:01:35.866977 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 04:01:35.866977 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:35.866977 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:01:35.866977 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:35.866977 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:35.866977 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:35.866977 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:35.866977 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:35.866977 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:35.868946 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:35.868946 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:35.868946 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:35.868946 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:35.868946 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:35.868946 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:35.868946 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:01:35.868946 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:01:35.868946 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:01:35.868946 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:01:35.868946 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:35.868946 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:35.868946 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:35.868946 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:35.868946 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:35.868946 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:35.870579 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:35.870579 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:35.870579 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:35.870579 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:35.870579 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:35.870579 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:35.870579 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:35.870579 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:35.870579 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:35.870579 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:35.870579 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:01:35.870579 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:01:35.870579 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 04:01:35.870579 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:35.879666 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 343/701] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 24 04:01:35 2022] GET /identity/v3/services/network => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:35.884633 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbdb97c-1eef-4b9c-a14d-350c6bbcbace None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:35.972395 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1caa6-1d05-4eb9-814f-7388bdd61603 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:36.016301 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264f556-8434-4d7b-9169-c3dcfcd1e1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:36.017226 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264f556-8434-4d7b-9169-c3dcfcd1e1ae None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:36.017226 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264f556-8434-4d7b-9169-c3dcfcd1e1ae None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:36.017470 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264f556-8434-4d7b-9169-c3dcfcd1e1ae None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:36.017930 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264f556-8434-4d7b-9169-c3dcfcd1e1ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:36.019639 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264f556-8434-4d7b-9169-c3dcfcd1e1ae None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:36.025991 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 359/702] 10.222.0.15 () {56 vars in 1087 bytes} [Wed Aug 24 04:01:35 2022] GET /identity/v3/services => generated 1002 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:01:36.028207 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264f556-8434-4d7b-9169-c3dcfcd1e1ae None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:36.068393 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbdb97c-1eef-4b9c-a14d-350c6bbcbace None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:36.117348 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a23c38-22fe-41ef-9265-9491c41e0465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:36.118301 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a23c38-22fe-41ef-9265-9491c41e0465 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:36.118529 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a23c38-22fe-41ef-9265-9491c41e0465 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:36.118804 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a23c38-22fe-41ef-9265-9491c41e0465 None admin] PATH_INFO: `/v3/services` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:36.119450 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a23c38-22fe-41ef-9265-9491c41e0465 None admin] RBAC: Adding query filter params (name=network) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:36.119819 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a23c38-22fe-41ef-9265-9491c41e0465 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:36.121471 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a23c38-22fe-41ef-9265-9491c41e0465 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:36.135241 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 344/703] 10.222.0.15 () {56 vars in 1112 bytes} [Wed Aug 24 04:01:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:01:36.140798 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a23c38-22fe-41ef-9265-9491c41e0465 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:36.170532 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:36.229329 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:36.242352 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264f556-8434-4d7b-9169-c3dcfcd1e1ae None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:36.303770 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07b264-b4c9-4a6a-9ec2-9940f2100f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:36.304454 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07b264-b4c9-4a6a-9ec2-9940f2100f14 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:36.304725 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07b264-b4c9-4a6a-9ec2-9940f2100f14 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:36.304992 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07b264-b4c9-4a6a-9ec2-9940f2100f14 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:36.305928 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07b264-b4c9-4a6a-9ec2-9940f2100f14 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:36.307549 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07b264-b4c9-4a6a-9ec2-9940f2100f14 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:36.323219 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-7e07b264-b4c9-4a6a-9ec2-9940f2100f14 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 04:01:36.323219 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:36.323219 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:01:36.323219 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:01:36.323219 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:01:36.323219 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:01:36.323219 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:01:36.323219 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:01:36.323219 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 04:01:36.323219 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:36.323219 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:01:36.323219 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:36.323219 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:36.323219 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:36.323219 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:36.323219 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:36.323219 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:36.324404 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:36.324404 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:36.324404 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:36.324404 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:36.324404 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:36.324404 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:36.324404 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:01:36.324404 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:01:36.324404 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:01:36.324404 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:01:36.324404 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:36.324404 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:36.324404 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:36.324404 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:36.324404 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:36.324404 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:36.325336 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:36.325336 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:36.325336 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:36.325336 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:36.325336 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:36.325336 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:36.325336 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:36.325336 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:36.325336 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:36.325336 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:36.325336 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:01:36.325336 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:01:36.325336 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 04:01:36.325336 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:36.328638 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 360/704] 10.222.0.15 () {56 vars in 1129 bytes} [Wed Aug 24 04:01:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:36.334486 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07b264-b4c9-4a6a-9ec2-9940f2100f14 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:36.361658 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a23c38-22fe-41ef-9265-9491c41e0465 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:36.411449 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532f375-cd91-4e87-9670-81c58a86bf5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:36.412376 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532f375-cd91-4e87-9670-81c58a86bf5b None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:36.412942 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532f375-cd91-4e87-9670-81c58a86bf5b None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:36.413357 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532f375-cd91-4e87-9670-81c58a86bf5b None admin] PATH_INFO: `/v3/services` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:36.414326 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f532f375-cd91-4e87-9670-81c58a86bf5b None admin] RBAC: Adding query filter params (type=network) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:36.414784 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f532f375-cd91-4e87-9670-81c58a86bf5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:36.416440 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f532f375-cd91-4e87-9670-81c58a86bf5b None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:36.424065 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 345/705] 10.222.0.15 () {56 vars in 1112 bytes} [Wed Aug 24 04:01:36 2022] GET /identity/v3/services?type=network => generated 350 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:01:36.435623 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532f375-cd91-4e87-9670-81c58a86bf5b None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:36.500097 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07b264-b4c9-4a6a-9ec2-9940f2100f14 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:36.531804 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:36.541853 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527dfd80-0a11-407c-956b-95bf4a985312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:36.542477 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527dfd80-0a11-407c-956b-95bf4a985312 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:36.542756 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527dfd80-0a11-407c-956b-95bf4a985312 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:36.543029 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527dfd80-0a11-407c-956b-95bf4a985312 None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:36.543714 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527dfd80-0a11-407c-956b-95bf4a985312 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:36.544016 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527dfd80-0a11-407c-956b-95bf4a985312 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:36.545580 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527dfd80-0a11-407c-956b-95bf4a985312 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:36.560705 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 361/706] 10.222.0.15 () {56 vars in 1124 bytes} [Wed Aug 24 04:01:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:01:36.562425 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527dfd80-0a11-407c-956b-95bf4a985312 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:36.569673 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:36.577267 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532f375-cd91-4e87-9670-81c58a86bf5b None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:36.619235 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb7a0f-dd92-4e78-b3c4-4458272cb4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:36.620083 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb7a0f-dd92-4e78-b3c4-4458272cb4a7 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:36.620198 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb7a0f-dd92-4e78-b3c4-4458272cb4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:36.620446 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb7a0f-dd92-4e78-b3c4-4458272cb4a7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:36.621266 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb7a0f-dd92-4e78-b3c4-4458272cb4a7 None admin] RBAC: Adding query filter params (interface=public, service_id=5a822b027ee84ed2ba7a265209457003, region_id=RegionOne) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:36.621579 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb7a0f-dd92-4e78-b3c4-4458272cb4a7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:36.623086 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb7a0f-dd92-4e78-b3c4-4458272cb4a7 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:36.632886 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 346/707] 10.222.0.15 () {56 vars in 1251 bytes} [Wed Aug 24 04:01:36 2022] GET /identity/v3/endpoints?service_id=5a822b027ee84ed2ba7a265209457003&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:36.640809 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb7a0f-dd92-4e78-b3c4-4458272cb4a7 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:36.723415 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527dfd80-0a11-407c-956b-95bf4a985312 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:36.772433 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb7a0f-dd92-4e78-b3c4-4458272cb4a7 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:36.789936 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a847e8-0899-42ef-bab4-597498599280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:36.791312 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a847e8-0899-42ef-bab4-597498599280 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:36.792129 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a847e8-0899-42ef-bab4-597498599280 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:36.792846 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a847e8-0899-42ef-bab4-597498599280 None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:36.794205 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a847e8-0899-42ef-bab4-597498599280 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:36.795139 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a847e8-0899-42ef-bab4-597498599280 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:36.798024 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a847e8-0899-42ef-bab4-597498599280 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:36.827251 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 362/708] 10.222.0.15 () {56 vars in 1124 bytes} [Wed Aug 24 04:01:36 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:36.831176 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a847e8-0899-42ef-bab4-597498599280 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:36.858905 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab0df8-c796-469a-a14c-f0051e531e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:36.861109 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab0df8-c796-469a-a14c-f0051e531e1a None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:36.861859 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab0df8-c796-469a-a14c-f0051e531e1a None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:36.862687 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab0df8-c796-469a-a14c-f0051e531e1a None admin] PATH_INFO: `/v3/services` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:36.864193 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ab0df8-c796-469a-a14c-f0051e531e1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:36.866538 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ab0df8-c796-469a-a14c-f0051e531e1a None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:36.875436 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 347/709] 10.222.0.15 () {56 vars in 1087 bytes} [Wed Aug 24 04:01:36 2022] GET /identity/v3/services => generated 1002 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:01:36.970535 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:37.089071 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a847e8-0899-42ef-bab4-597498599280 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:37.175592 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f00e7b-26fa-41a6-b23f-7ab42d96640d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:37.176684 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f00e7b-26fa-41a6-b23f-7ab42d96640d None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:37.177175 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f00e7b-26fa-41a6-b23f-7ab42d96640d None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:37.178094 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f00e7b-26fa-41a6-b23f-7ab42d96640d None admin] PATH_INFO: `/v3/endpoints` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:37.179476 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f00e7b-26fa-41a6-b23f-7ab42d96640d None admin] RBAC: Adding query filter params (interface=public, service_id=6a22a5ff304140618e9906dbb610d58c, region_id=RegionOne) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:37.180023 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f00e7b-26fa-41a6-b23f-7ab42d96640d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:37.182772 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f00e7b-26fa-41a6-b23f-7ab42d96640d None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:37.194697 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 363/710] 10.222.0.15 () {56 vars in 1251 bytes} [Wed Aug 24 04:01:36 2022] GET /identity/v3/endpoints?service_id=6a22a5ff304140618e9906dbb610d58c&interface=public®ion_id=RegionOne => generated 194 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:01:37.204624 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab0df8-c796-469a-a14c-f0051e531e1a None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:37.249560 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:37.350574 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab0df8-c796-469a-a14c-f0051e531e1a None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:37.409592 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e6099-45a7-4847-9a94-535cdd9d68cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:37.411096 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e6099-45a7-4847-9a94-535cdd9d68cf None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:37.411939 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e6099-45a7-4847-9a94-535cdd9d68cf None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:37.412690 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e6099-45a7-4847-9a94-535cdd9d68cf None admin] PATH_INFO: `/v3/services` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:37.414109 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e6099-45a7-4847-9a94-535cdd9d68cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:37.416965 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e6099-45a7-4847-9a94-535cdd9d68cf None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:37.429843 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 348/711] 10.222.0.15 () {56 vars in 1087 bytes} [Wed Aug 24 04:01:37 2022] GET /identity/v3/services => generated 1002 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:01:37.639174 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52c963-b9d4-4545-97ed-89f4723ccf67 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:37.639669 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52c963-b9d4-4545-97ed-89f4723ccf67 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:37.640084 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52c963-b9d4-4545-97ed-89f4723ccf67 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:37.642608 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 364/712] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:01:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:01:37.651166 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b9671-bf16-4eba-91c1-07c59f6ca63f None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:37.652010 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b9671-bf16-4eba-91c1-07c59f6ca63f None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:37.652635 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b9671-bf16-4eba-91c1-07c59f6ca63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:37.679388 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-091b9671-bf16-4eba-91c1-07c59f6ca63f None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:01:37.681339 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-091b9671-bf16-4eba-91c1-07c59f6ca63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:37.820347 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 349/713] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:01:37 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:01:38.176500 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52c963-b9d4-4545-97ed-89f4723ccf67 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:38.303251 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52c963-b9d4-4545-97ed-89f4723ccf67 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:38.343364 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:38.371769 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66af15-0b54-4da5-afc9-2855f22426ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:38.372798 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66af15-0b54-4da5-afc9-2855f22426ed None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:38.373230 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66af15-0b54-4da5-afc9-2855f22426ed None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:38.373646 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66af15-0b54-4da5-afc9-2855f22426ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:38.393278 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66af15-0b54-4da5-afc9-2855f22426ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:01:38.402483 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-1f66af15-0b54-4da5-afc9-2855f22426ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:01:38.402483 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:38.402483 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:38.402483 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:38.402483 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:38.402483 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:38.402483 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:38.402483 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:38.402483 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:38.402483 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:38.402483 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:38.402483 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:38.402483 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:01:38.402483 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:01:38.402483 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:01:38.402483 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:01:38.403501 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:01:38.403501 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:01:38.403501 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:01:38.403501 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:01:38.403501 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:38.403501 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:38.403501 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:38.403501 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:38.403501 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:38.403501 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:38.403501 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:38.403501 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:38.403501 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:38.403501 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:38.403501 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:38.403501 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:38.404357 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:38.404357 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:38.404357 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:38.404357 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:38.404357 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:01:38.404357 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:01:38.404357 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:01:38.404357 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:01:38.404357 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:01:38.404357 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:01:38.404357 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:01:38.404357 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:38.408618 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 365/714] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 24 04:01:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:38.414852 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b9671-bf16-4eba-91c1-07c59f6ca63f None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:38.448725 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:38.532200 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5d1d8-64b4-4377-a313-96d369d46616 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:38.532725 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5d1d8-64b4-4377-a313-96d369d46616 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:38.533236 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5d1d8-64b4-4377-a313-96d369d46616 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:38.537255 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 366/715] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:01:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:01:38.543083 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6065a3-22e6-4089-90b0-683c9b70ba6a None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:38.543403 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6065a3-22e6-4089-90b0-683c9b70ba6a None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:38.543677 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6065a3-22e6-4089-90b0-683c9b70ba6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:38.564117 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-5c6065a3-22e6-4089-90b0-683c9b70ba6a None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:01:38.565440 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-5c6065a3-22e6-4089-90b0-683c9b70ba6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:38.622575 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b9671-bf16-4eba-91c1-07c59f6ca63f None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:38.665457 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 367/716] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:01:38 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:01:38.680039 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728d296-e0b1-4e13-96af-186b96d0fbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:38.681078 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728d296-e0b1-4e13-96af-186b96d0fbcd None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:38.681603 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728d296-e0b1-4e13-96af-186b96d0fbcd None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:38.682080 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728d296-e0b1-4e13-96af-186b96d0fbcd None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:38.682992 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5728d296-e0b1-4e13-96af-186b96d0fbcd None admin] RBAC: Adding query filter params (name=admin) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:38.683522 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5728d296-e0b1-4e13-96af-186b96d0fbcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:38.685184 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5728d296-e0b1-4e13-96af-186b96d0fbcd None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:38.696231 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 350/717] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 04:01:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:38.705770 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6065a3-22e6-4089-90b0-683c9b70ba6a None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:38.827602 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6065a3-22e6-4089-90b0-683c9b70ba6a None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:38.841171 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:38.867642 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e2eda5-fba2-4f0a-af4d-55499fc053c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:38.868284 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2eda5-fba2-4f0a-af4d-55499fc053c8 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:38.868591 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2eda5-fba2-4f0a-af4d-55499fc053c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:38.868860 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2eda5-fba2-4f0a-af4d-55499fc053c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:38.880542 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e2eda5-fba2-4f0a-af4d-55499fc053c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:38.882047 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e2eda5-fba2-4f0a-af4d-55499fc053c8 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:38.898448 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-82e2eda5-fba2-4f0a-af4d-55499fc053c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:38.898448 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:38.898448 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:38.898448 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:38.898448 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:38.898448 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:38.898448 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:38.898448 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:38.898448 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:38.898448 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:38.898448 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:38.898448 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:38.898448 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:01:38.898448 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:01:38.898448 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:01:38.898448 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:01:38.899510 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:38.899510 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:38.899510 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:38.899510 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:38.899510 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:38.899510 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:38.899510 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:38.899510 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:38.899510 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:38.899510 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:38.899510 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:38.899510 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:38.899510 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:38.899510 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:38.899510 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:38.899510 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:38.899510 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:01:38.900914 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:01:38.900914 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:38.900914 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:38.904605 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 368/718] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:01:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:38.906838 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728d296-e0b1-4e13-96af-186b96d0fbcd None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:39.064136 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e2eda5-fba2-4f0a-af4d-55499fc053c8 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:39.067011 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:39.103833 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728d296-e0b1-4e13-96af-186b96d0fbcd None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:39.168220 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e7825-cd3d-4e90-af4c-768173cb8083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:39.169575 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e7825-cd3d-4e90-af4c-768173cb8083 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:39.170163 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e7825-cd3d-4e90-af4c-768173cb8083 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:39.170658 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e7825-cd3d-4e90-af4c-768173cb8083 None admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:39.171928 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e7825-cd3d-4e90-af4c-768173cb8083 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:39.172478 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e7825-cd3d-4e90-af4c-768173cb8083 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:39.183227 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e7825-cd3d-4e90-af4c-768173cb8083 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:39.192187 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e2eda5-fba2-4f0a-af4d-55499fc053c8 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:39.204117 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 351/719] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 04:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:01:39.210861 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e7825-cd3d-4e90-af4c-768173cb8083 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:39.245451 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b2b31-1d11-42e3-a791-dea2d143fdbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:39.246126 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b2b31-1d11-42e3-a791-dea2d143fdbd None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:39.246399 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b2b31-1d11-42e3-a791-dea2d143fdbd None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:39.246789 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b2b31-1d11-42e3-a791-dea2d143fdbd None admin] PATH_INFO: `/v3/services/image` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:39.247506 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b2b31-1d11-42e3-a791-dea2d143fdbd None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:39.249222 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b2b31-1d11-42e3-a791-dea2d143fdbd None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:39.260888 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-835b2b31-1d11-42e3-a791-dea2d143fdbd None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 04:01:39.260888 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:39.260888 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:01:39.260888 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:01:39.260888 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:01:39.260888 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:01:39.260888 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:01:39.260888 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:01:39.260888 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 04:01:39.260888 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:39.260888 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:01:39.260888 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:39.260888 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:39.260888 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:39.260888 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:39.260888 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:39.260888 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:39.262063 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:39.262063 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:39.262063 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:39.262063 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:39.262063 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:39.262063 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:39.262063 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:01:39.262063 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:01:39.262063 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:01:39.262063 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:01:39.262063 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:39.262063 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:39.262063 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:39.262063 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:39.262063 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:39.262063 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:39.262933 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:39.262933 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:39.262933 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:39.262933 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:39.262933 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:39.262933 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:39.262933 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:39.262933 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:39.262933 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:39.262933 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:39.262933 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:01:39.262933 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:01:39.262933 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 04:01:39.262933 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:39.264736 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 369/720] 10.222.0.15 () {56 vars in 1105 bytes} [Wed Aug 24 04:01:39 2022] GET /identity/v3/services/image => generated 86 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:01:39.271502 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b2b31-1d11-42e3-a791-dea2d143fdbd None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:39.307348 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:39.426691 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b2b31-1d11-42e3-a791-dea2d143fdbd None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:39.434361 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e7825-cd3d-4e90-af4c-768173cb8083 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:39.483276 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb88bf-77c0-450d-bf7f-fafc15142ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:39.484264 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb88bf-77c0-450d-bf7f-fafc15142ae0 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:39.484696 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb88bf-77c0-450d-bf7f-fafc15142ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:39.485119 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb88bf-77c0-450d-bf7f-fafc15142ae0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:39.494197 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fb88bf-77c0-450d-bf7f-fafc15142ae0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:39.495976 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fb88bf-77c0-450d-bf7f-fafc15142ae0 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:39.500924 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:39.505149 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd579185-666b-4987-91f5-3569780e4291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:39.506314 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd579185-666b-4987-91f5-3569780e4291 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:39.506937 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd579185-666b-4987-91f5-3569780e4291 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:39.507613 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd579185-666b-4987-91f5-3569780e4291 None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:39.510242 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd579185-666b-4987-91f5-3569780e4291 None admin] RBAC: Adding query filter params (name=image) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:39.510923 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd579185-666b-4987-91f5-3569780e4291 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:39.513743 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd579185-666b-4987-91f5-3569780e4291 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:39.517959 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-09fb88bf-77c0-450d-bf7f-fafc15142ae0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:01:39.517959 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:39.517959 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:39.517959 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:39.517959 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:39.517959 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:39.517959 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:39.517959 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:39.517959 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:39.517959 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:39.517959 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:39.517959 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:39.517959 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:01:39.517959 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:01:39.517959 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:01:39.517959 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:01:39.518935 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:39.518935 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:39.518935 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:01:39.518935 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:01:39.518935 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:01:39.518935 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:01:39.518935 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:39.518935 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:39.518935 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:39.518935 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:39.518935 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:39.518935 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:39.518935 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:39.518935 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:39.518935 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:39.518935 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:39.518935 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:39.518935 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:39.520201 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:39.520201 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:39.520201 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:01:39.520201 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:01:39.520201 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:01:39.520201 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:01:39.520201 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:01:39.520201 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:01:39.520201 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:01:39.520201 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:39.527407 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 370/721] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:01:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:01:39.527959 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 352/722] 10.222.0.15 () {56 vars in 1093 bytes} [Wed Aug 24 04:01:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:39.529429 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd579185-666b-4987-91f5-3569780e4291 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:39.533362 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb88bf-77c0-450d-bf7f-fafc15142ae0 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:39.701420 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb88bf-77c0-450d-bf7f-fafc15142ae0 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:39.706813 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:39.723300 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd579185-666b-4987-91f5-3569780e4291 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:39.751321 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8bc582-1044-4b1a-8798-ba052a607425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:39.752305 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8bc582-1044-4b1a-8798-ba052a607425 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:39.753160 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8bc582-1044-4b1a-8798-ba052a607425 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:39.753587 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8bc582-1044-4b1a-8798-ba052a607425 None admin] PATH_INFO: `/v3/users` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:39.754510 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8bc582-1044-4b1a-8798-ba052a607425 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:39.754970 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8bc582-1044-4b1a-8798-ba052a607425 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:39.757579 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8bc582-1044-4b1a-8798-ba052a607425 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:39.782776 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06829c-3fdd-4290-b695-8d341c36e2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:39.783672 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 353/723] 10.222.0.15 () {56 vars in 1133 bytes} [Wed Aug 24 04:01:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:39.786533 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06829c-3fdd-4290-b695-8d341c36e2cf None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:39.787178 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06829c-3fdd-4290-b695-8d341c36e2cf None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:39.787632 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06829c-3fdd-4290-b695-8d341c36e2cf None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:39.788516 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06829c-3fdd-4290-b695-8d341c36e2cf None admin] RBAC: Adding query filter params (type=image) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:39.788991 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06829c-3fdd-4290-b695-8d341c36e2cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:39.790682 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06829c-3fdd-4290-b695-8d341c36e2cf None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:39.792488 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8bc582-1044-4b1a-8798-ba052a607425 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:39.800013 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 371/724] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:01:39 2022] GET /identity/v3/services?type=image => generated 350 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:39.813232 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06829c-3fdd-4290-b695-8d341c36e2cf None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:39.895497 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:39.957701 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06829c-3fdd-4290-b695-8d341c36e2cf None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:39.968800 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8bc582-1044-4b1a-8798-ba052a607425 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:39.998440 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9364b0d-7277-4d38-8750-95648f4634fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:39.999418 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9364b0d-7277-4d38-8750-95648f4634fd None admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:39.999923 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9364b0d-7277-4d38-8750-95648f4634fd None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:40.000443 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9364b0d-7277-4d38-8750-95648f4634fd None admin] PATH_INFO: `/v3/endpoints` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:40.001335 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9364b0d-7277-4d38-8750-95648f4634fd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:40.002915 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9364b0d-7277-4d38-8750-95648f4634fd None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:40.012750 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad5867c-c99b-4406-8781-a364ac3577fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:40.013436 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5867c-c99b-4406-8781-a364ac3577fe None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:40.013713 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5867c-c99b-4406-8781-a364ac3577fe None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:40.013980 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5867c-c99b-4406-8781-a364ac3577fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:40.029312 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 372/725] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 24 04:01:39 2022] POST /identity/v3/endpoints => generated 327 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:01:40.030907 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85e01c-81f2-4e1a-b69b-1fdb1cb728f1 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:40.031296 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85e01c-81f2-4e1a-b69b-1fdb1cb728f1 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:40.031696 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85e01c-81f2-4e1a-b69b-1fdb1cb728f1 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:40.033330 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 373/726] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:01:40.039606 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dac6a-905d-40dd-9c74-e9c1c6b266a8 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:40.039890 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dac6a-905d-40dd-9c74-e9c1c6b266a8 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:40.040277 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dac6a-905d-40dd-9c74-e9c1c6b266a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:40.062287 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-2c0dac6a-905d-40dd-9c74-e9c1c6b266a8 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:01:40.063732 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-2c0dac6a-905d-40dd-9c74-e9c1c6b266a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:40.068697 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:40.134668 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad5867c-c99b-4406-8781-a364ac3577fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:40.135849 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad5867c-c99b-4406-8781-a364ac3577fe None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:40.197368 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 374/727] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:01:40 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:01:40.198896 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708ca79-3bf2-4fa0-a58e-3e0ecac6cca4 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:40.199184 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708ca79-3bf2-4fa0-a58e-3e0ecac6cca4 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:40.199499 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708ca79-3bf2-4fa0-a58e-3e0ecac6cca4 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:40.201165 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 375/728] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:01:40.210704 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b86ea4-262b-4d1a-b261-b30ed9cf2a43 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:40.210995 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b86ea4-262b-4d1a-b261-b30ed9cf2a43 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:40.211285 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b86ea4-262b-4d1a-b261-b30ed9cf2a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:40.248047 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:40.251844 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-08b86ea4-262b-4d1a-b261-b30ed9cf2a43 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:01:40.253958 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-08b86ea4-262b-4d1a-b261-b30ed9cf2a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:40.316500 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 354/729] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 24 04:01:39 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 04:01:40.326343 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad5867c-c99b-4406-8781-a364ac3577fe None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:40.383422 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 376/730] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:01:40 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:01:40.474508 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad5867c-c99b-4406-8781-a364ac3577fe None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:40.528576 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f0d1b-269e-4664-bd13-174b8cac8027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:40.529642 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f0d1b-269e-4664-bd13-174b8cac8027 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:40.530128 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f0d1b-269e-4664-bd13-174b8cac8027 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:40.530612 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f0d1b-269e-4664-bd13-174b8cac8027 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:40.535370 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b86ea4-262b-4d1a-b261-b30ed9cf2a43 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:40.546310 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f0d1b-269e-4664-bd13-174b8cac8027 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:40.548218 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f0d1b-269e-4664-bd13-174b8cac8027 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:40.566520 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-c50f0d1b-269e-4664-bd13-174b8cac8027 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:40.566520 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:40.566520 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:40.566520 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:40.566520 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:40.566520 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:40.566520 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:40.566520 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:40.566520 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:40.566520 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:40.566520 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:40.566520 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:40.566520 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:01:40.566520 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:01:40.566520 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:01:40.566520 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:01:40.567947 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:40.567947 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:40.567947 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:40.567947 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:40.567947 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:40.567947 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:40.567947 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:40.567947 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:40.567947 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:40.567947 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:40.567947 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:40.567947 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:40.567947 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:40.567947 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:40.567947 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:40.567947 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:40.567947 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:01:40.569178 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:01:40.569178 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:40.569178 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:40.571255 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 355/731] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:01:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:40.578831 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f0d1b-269e-4664-bd13-174b8cac8027 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:40.598084 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:40.670421 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:40.718674 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f0d1b-269e-4664-bd13-174b8cac8027 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:40.725876 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b86ea4-262b-4d1a-b261-b30ed9cf2a43 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:40.763903 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ee482-fc69-4e96-a70e-09f034393ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:40.764671 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ee482-fc69-4e96-a70e-09f034393ac0 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:40.765083 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ee482-fc69-4e96-a70e-09f034393ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:40.765224 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ee482-fc69-4e96-a70e-09f034393ac0 None admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:40.765873 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ee482-fc69-4e96-a70e-09f034393ac0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:40.766176 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ee482-fc69-4e96-a70e-09f034393ac0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:40.767831 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ee482-fc69-4e96-a70e-09f034393ac0 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:40.776382 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d8e6f2-49a9-4a2c-a1f4-a76c4e0f6e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:40.777466 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8e6f2-49a9-4a2c-a1f4-a76c4e0f6e41 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:40.777933 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8e6f2-49a9-4a2c-a1f4-a76c4e0f6e41 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:40.778425 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8e6f2-49a9-4a2c-a1f4-a76c4e0f6e41 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:40.779519 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d8e6f2-49a9-4a2c-a1f4-a76c4e0f6e41 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:40.782067 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d8e6f2-49a9-4a2c-a1f4-a76c4e0f6e41 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:40.782945 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 356/732] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 04:01:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:40.784005 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ee482-fc69-4e96-a70e-09f034393ac0 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:40.799641 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-57d8e6f2-49a9-4a2c-a1f4-a76c4e0f6e41 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 04:01:40.799641 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:40.799641 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:01:40.799641 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:01:40.799641 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:01:40.799641 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:01:40.799641 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:01:40.799641 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:01:40.799641 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 04:01:40.799641 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:40.799641 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:01:40.799641 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:40.799641 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:40.799641 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:40.799641 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:40.799641 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:40.799641 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:40.801638 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:40.801638 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:40.801638 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:40.801638 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:40.801638 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:40.801638 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:40.801638 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:01:40.801638 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:01:40.801638 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:01:40.801638 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:01:40.801638 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:40.801638 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:40.801638 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:40.801638 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:40.801638 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:40.801638 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:40.803432 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:40.803432 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:40.803432 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:40.803432 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:40.803432 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:40.803432 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:40.803432 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:40.803432 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:40.803432 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:40.803432 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:40.803432 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:01:40.803432 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:01:40.803432 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 04:01:40.803432 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:40.803432 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 377/733] 10.222.0.15 () {56 vars in 1129 bytes} [Wed Aug 24 04:01:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:40.804874 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d8e6f2-49a9-4a2c-a1f4-a76c4e0f6e41 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:40.902446 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:40.950981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ee482-fc69-4e96-a70e-09f034393ac0 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:40.962335 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d8e6f2-49a9-4a2c-a1f4-a76c4e0f6e41 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:41.000537 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:41.008476 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee5163-ee14-4428-85b6-fc76f37a578a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:41.009206 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee5163-ee14-4428-85b6-fc76f37a578a None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:41.009540 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee5163-ee14-4428-85b6-fc76f37a578a None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:41.009838 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee5163-ee14-4428-85b6-fc76f37a578a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:41.017501 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ee5163-ee14-4428-85b6-fc76f37a578a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:41.018044 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9766f36b-fc23-422d-9831-b2bdebf21185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:41.018968 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ee5163-ee14-4428-85b6-fc76f37a578a None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:41.019134 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766f36b-fc23-422d-9831-b2bdebf21185 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:41.019888 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766f36b-fc23-422d-9831-b2bdebf21185 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:41.020015 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766f36b-fc23-422d-9831-b2bdebf21185 None admin] PATH_INFO: `/v3/services/network` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:41.021026 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9766f36b-fc23-422d-9831-b2bdebf21185 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:41.023621 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9766f36b-fc23-422d-9831-b2bdebf21185 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:41.032281 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-05ee5163-ee14-4428-85b6-fc76f37a578a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:01:41.032281 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:41.032281 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:41.032281 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:41.032281 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:41.032281 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:41.032281 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:41.032281 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:41.032281 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:41.032281 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:41.032281 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:41.032281 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:41.032281 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:01:41.032281 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:01:41.032281 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:01:41.034035 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:01:41.034035 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:41.034035 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:41.034035 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:41.034035 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:41.034035 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:41.034035 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:41.034035 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:41.034035 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:41.034035 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:41.034035 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:41.034035 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:41.034035 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:41.034035 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:41.034035 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:41.034035 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:41.034035 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:41.035893 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:01:41.035893 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:01:41.035893 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:01:41.035893 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:01:41.035893 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:01:41.035893 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:01:41.035893 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:01:41.035893 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:41.035893 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 378/734] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 24 04:01:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:41.035893 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee5163-ee14-4428-85b6-fc76f37a578a None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:41.043835 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-9766f36b-fc23-422d-9831-b2bdebf21185 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 04:01:41.043835 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:41.043835 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:01:41.043835 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:01:41.043835 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:01:41.043835 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:01:41.043835 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:01:41.043835 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:01:41.043835 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 04:01:41.043835 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:41.043835 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:01:41.043835 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:41.043835 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:41.043835 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:41.043835 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:41.043835 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:41.043835 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:41.045708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:41.045708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:41.045708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:41.045708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:41.045708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:41.045708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:41.045708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:01:41.045708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:01:41.045708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:01:41.045708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:01:41.045708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:41.045708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:41.045708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:41.045708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:41.045708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:41.045708 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:41.051759 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:41.051759 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:41.051759 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:41.051759 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:41.051759 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:41.051759 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:41.051759 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:41.051759 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:41.051759 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:41.051759 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:41.051759 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:01:41.051759 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:01:41.051759 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 04:01:41.051759 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:41.051759 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 357/735] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 24 04:01:40 2022] GET /identity/v3/services/network => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:41.052719 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9766f36b-fc23-422d-9831-b2bdebf21185 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:41.167948 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee5163-ee14-4428-85b6-fc76f37a578a None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:41.209027 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9766f36b-fc23-422d-9831-b2bdebf21185 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:41.225432 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710d915-58ae-4e61-83dc-ef6d8c1889ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:41.226605 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710d915-58ae-4e61-83dc-ef6d8c1889ce None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:41.227056 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710d915-58ae-4e61-83dc-ef6d8c1889ce None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:41.227927 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710d915-58ae-4e61-83dc-ef6d8c1889ce None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:41.228812 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3710d915-58ae-4e61-83dc-ef6d8c1889ce None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:41.229427 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3710d915-58ae-4e61-83dc-ef6d8c1889ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:41.231226 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3710d915-58ae-4e61-83dc-ef6d8c1889ce None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:41.245262 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 379/736] 10.222.0.15 () {56 vars in 1124 bytes} [Wed Aug 24 04:01:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:41.245262 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710d915-58ae-4e61-83dc-ef6d8c1889ce None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:41.263185 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25b60f-78ba-4acb-a7c6-6a1dabbbb5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:41.263802 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25b60f-78ba-4acb-a7c6-6a1dabbbb5e0 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:41.264678 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25b60f-78ba-4acb-a7c6-6a1dabbbb5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:41.264948 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25b60f-78ba-4acb-a7c6-6a1dabbbb5e0 None admin] PATH_INFO: `/v3/projects` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:41.265946 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25b60f-78ba-4acb-a7c6-6a1dabbbb5e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:41.266246 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25b60f-78ba-4acb-a7c6-6a1dabbbb5e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:41.268527 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25b60f-78ba-4acb-a7c6-6a1dabbbb5e0 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:41.270983 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:41.297775 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 358/737] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 24 04:01:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:41.297775 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25b60f-78ba-4acb-a7c6-6a1dabbbb5e0 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:41.328401 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:41.399452 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710d915-58ae-4e61-83dc-ef6d8c1889ce None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:41.454704 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc55714-685a-40d0-81ef-4f553241230f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:41.455867 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc55714-685a-40d0-81ef-4f553241230f None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:41.456348 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc55714-685a-40d0-81ef-4f553241230f None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:41.456820 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc55714-685a-40d0-81ef-4f553241230f None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:41.457940 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc55714-685a-40d0-81ef-4f553241230f None admin] RBAC: Adding query filter params (name=network) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:41.458491 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc55714-685a-40d0-81ef-4f553241230f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:41.461390 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc55714-685a-40d0-81ef-4f553241230f None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:41.469274 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25b60f-78ba-4acb-a7c6-6a1dabbbb5e0 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:41.475410 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 380/738] 10.222.0.15 () {56 vars in 1112 bytes} [Wed Aug 24 04:01:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:41.475410 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc55714-685a-40d0-81ef-4f553241230f None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:41.522967 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843cfb1a-4526-4561-9d57-5794dd131748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:41.523765 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843cfb1a-4526-4561-9d57-5794dd131748 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:41.524066 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843cfb1a-4526-4561-9d57-5794dd131748 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:41.524338 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843cfb1a-4526-4561-9d57-5794dd131748 None admin] PATH_INFO: `/v3/services` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:41.525047 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843cfb1a-4526-4561-9d57-5794dd131748 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:41.525365 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843cfb1a-4526-4561-9d57-5794dd131748 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:41.526799 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843cfb1a-4526-4561-9d57-5794dd131748 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:41.532942 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 359/739] 10.222.0.15 () {56 vars in 1124 bytes} [Wed Aug 24 04:01:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:41.538654 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843cfb1a-4526-4561-9d57-5794dd131748 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:41.626053 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:41.639305 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc55714-685a-40d0-81ef-4f553241230f None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:41.681863 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:41.695218 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843cfb1a-4526-4561-9d57-5794dd131748 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:41.712862 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc06eb1-ba21-4c4c-bfd9-2d1aeaee2b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:41.713660 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc06eb1-ba21-4c4c-bfd9-2d1aeaee2b11 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:41.713948 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc06eb1-ba21-4c4c-bfd9-2d1aeaee2b11 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:41.714794 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc06eb1-ba21-4c4c-bfd9-2d1aeaee2b11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:41.715450 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc06eb1-ba21-4c4c-bfd9-2d1aeaee2b11 None admin] RBAC: Adding query filter params (role.id=df6a8bb215d54f71a0b6988a9c01f5e4, scope.project.id=5c317b3ce1d1468f95bc01ba2587e623, user.id=3796b1549762419686cb3b00af1a963e) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:41.715450 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc06eb1-ba21-4c4c-bfd9-2d1aeaee2b11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:41.716910 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc06eb1-ba21-4c4c-bfd9-2d1aeaee2b11 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:41.724570 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 381/740] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 24 04:01:41 2022] GET /identity/v3/role_assignments?user.id=3796b1549762419686cb3b00af1a963e&scope.project.id=5c317b3ce1d1468f95bc01ba2587e623&role.id=df6a8bb215d54f71a0b6988a9c01f5e4 => generated 608 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:41.728201 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc06eb1-ba21-4c4c-bfd9-2d1aeaee2b11 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:41.748108 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696cc7e-89fe-4507-8a3d-f98a745b7bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:41.748734 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696cc7e-89fe-4507-8a3d-f98a745b7bf1 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:41.749570 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696cc7e-89fe-4507-8a3d-f98a745b7bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:41.749570 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696cc7e-89fe-4507-8a3d-f98a745b7bf1 None admin] PATH_INFO: `/v3/services` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:41.749942 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4696cc7e-89fe-4507-8a3d-f98a745b7bf1 None admin] RBAC: Adding query filter params (type=network) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:41.750247 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4696cc7e-89fe-4507-8a3d-f98a745b7bf1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:41.752022 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4696cc7e-89fe-4507-8a3d-f98a745b7bf1 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:41.759409 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 360/741] 10.222.0.15 () {56 vars in 1112 bytes} [Wed Aug 24 04:01:41 2022] GET /identity/v3/services?type=network => generated 350 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:41.765556 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696cc7e-89fe-4507-8a3d-f98a745b7bf1 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:41.905769 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc06eb1-ba21-4c4c-bfd9-2d1aeaee2b11 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:41.959771 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696cc7e-89fe-4507-8a3d-f98a745b7bf1 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:41.967997 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fbbab-f020-42cc-982a-689982cd7d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:41.969377 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fbbab-f020-42cc-982a-689982cd7d1c None admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:41.970691 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fbbab-f020-42cc-982a-689982cd7d1c None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:41.971683 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fbbab-f020-42cc-982a-689982cd7d1c None admin] PATH_INFO: `/v3/endpoints` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:41.973513 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621fbbab-f020-42cc-982a-689982cd7d1c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:41.978467 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621fbbab-f020-42cc-982a-689982cd7d1c None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:41.993915 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:42.018475 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb2b4d-29ad-433e-8591-851cc57f24be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:42.018952 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 382/742] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 24 04:01:41 2022] POST /identity/v3/endpoints => generated 346 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:01:42.020179 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb2b4d-29ad-433e-8591-851cc57f24be None admin] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:42.020347 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb2b4d-29ad-433e-8591-851cc57f24be None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:42.020971 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb2b4d-29ad-433e-8591-851cc57f24be None admin] PATH_INFO: `/v3/endpoints` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:42.022152 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bb2b4d-29ad-433e-8591-851cc57f24be None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:42.024504 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bb2b4d-29ad-433e-8591-851cc57f24be None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:42.060218 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 361/743] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 24 04:01:41 2022] POST /identity/v3/endpoints => generated 337 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:01:42.564705 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97061d1b-41fd-44cc-b628-c8a5eac9b25e None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:42.565259 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97061d1b-41fd-44cc-b628-c8a5eac9b25e None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:42.565369 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97061d1b-41fd-44cc-b628-c8a5eac9b25e None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:42.566674 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 383/744] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:01:42.574346 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1725410-b9f6-409c-ad50-3b14e649509b None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:42.575053 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1725410-b9f6-409c-ad50-3b14e649509b None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:42.575053 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1725410-b9f6-409c-ad50-3b14e649509b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:42.597453 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-c1725410-b9f6-409c-ad50-3b14e649509b None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:01:42.598982 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-c1725410-b9f6-409c-ad50-3b14e649509b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:42.723243 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 362/745] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:01:42 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:01:43.057758 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97061d1b-41fd-44cc-b628-c8a5eac9b25e None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:43.120326 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:43.198621 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97061d1b-41fd-44cc-b628-c8a5eac9b25e None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:43.237528 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc6bb0-4fc3-41b0-9a4a-32a9d241da62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:43.238140 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc6bb0-4fc3-41b0-9a4a-32a9d241da62 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:43.238418 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc6bb0-4fc3-41b0-9a4a-32a9d241da62 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:43.238673 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc6bb0-4fc3-41b0-9a4a-32a9d241da62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:43.341983 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc6bb0-4fc3-41b0-9a4a-32a9d241da62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:43.343554 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc6bb0-4fc3-41b0-9a4a-32a9d241da62 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:43.387140 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:43.479306 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 384/746] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 24 04:01:43 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:01:43.482312 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1725410-b9f6-409c-ad50-3b14e649509b None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:43.608893 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1725410-b9f6-409c-ad50-3b14e649509b None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:43.612976 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:43.653704 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a96ba6-1045-4cc4-9dd8-729c9d9d55b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:43.654696 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a96ba6-1045-4cc4-9dd8-729c9d9d55b0 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:43.655164 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a96ba6-1045-4cc4-9dd8-729c9d9d55b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:43.655644 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a96ba6-1045-4cc4-9dd8-729c9d9d55b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:43.667809 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a96ba6-1045-4cc4-9dd8-729c9d9d55b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:43.669760 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a96ba6-1045-4cc4-9dd8-729c9d9d55b0 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:43.687389 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-04a96ba6-1045-4cc4-9dd8-729c9d9d55b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:43.687389 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:43.687389 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:43.687389 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:43.687389 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:43.687389 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:43.687389 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:43.687389 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:43.687389 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:43.687389 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:43.687389 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:43.687389 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:43.687389 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:01:43.687389 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:01:43.687389 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:01:43.687389 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:01:43.688474 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:43.688474 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:43.688474 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:43.688474 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:43.688474 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:43.688474 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:43.688474 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:43.688474 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:43.688474 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:43.688474 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:43.688474 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:43.688474 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:43.688474 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:43.688474 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:43.688474 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:43.688474 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:43.688474 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:01:43.689534 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:01:43.689534 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:01:43.689534 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:43.691448 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 363/747] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:01:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:43.697832 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc6bb0-4fc3-41b0-9a4a-32a9d241da62 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:43.842419 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc6bb0-4fc3-41b0-9a4a-32a9d241da62 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:43.888546 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81fbf28-4514-4f25-aa52-22312f86f273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:43.889192 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fbf28-4514-4f25-aa52-22312f86f273 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:43.889536 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fbf28-4514-4f25-aa52-22312f86f273 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:43.889817 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fbf28-4514-4f25-aa52-22312f86f273 None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:43.895032 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81fbf28-4514-4f25-aa52-22312f86f273 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:43.895032 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81fbf28-4514-4f25-aa52-22312f86f273 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:43.895032 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81fbf28-4514-4f25-aa52-22312f86f273 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:43.907173 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:43.914679 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 385/748] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 04:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:44.214602 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1e2f4-2772-4fca-9f04-3bbacc6f581c None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:44.214882 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1e2f4-2772-4fca-9f04-3bbacc6f581c None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:44.215046 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1e2f4-2772-4fca-9f04-3bbacc6f581c None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:44.216630 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 364/749] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:01:44.222600 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819787c-a512-4a76-b04f-6b77acc1a65e None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:44.222950 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819787c-a512-4a76-b04f-6b77acc1a65e None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:44.223160 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819787c-a512-4a76-b04f-6b77acc1a65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:44.243940 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-b819787c-a512-4a76-b04f-6b77acc1a65e None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:01:44.245163 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-b819787c-a512-4a76-b04f-6b77acc1a65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:44.344223 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 386/750] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:01:44 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:01:44.401561 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232a204-28f0-4010-8636-882fd8f66fec None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:44.401862 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232a204-28f0-4010-8636-882fd8f66fec None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:44.402103 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232a204-28f0-4010-8636-882fd8f66fec None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:44.403467 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 365/751] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:01:44.409590 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e67a5-0158-4a7f-8828-eaccdccda070 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:44.409888 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e67a5-0158-4a7f-8828-eaccdccda070 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:44.410295 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e67a5-0158-4a7f-8828-eaccdccda070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:44.439679 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-408e67a5-0158-4a7f-8828-eaccdccda070 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:01:44.441675 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-408e67a5-0158-4a7f-8828-eaccdccda070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:44.544450 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 387/752] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:01:44 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:01:44.669014 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232a204-28f0-4010-8636-882fd8f66fec None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:44.794416 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232a204-28f0-4010-8636-882fd8f66fec None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:44.832899 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b86676-cd04-45fc-b909-2dc9a773b84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:44.833584 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b86676-cd04-45fc-b909-2dc9a773b84d None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:44.833860 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b86676-cd04-45fc-b909-2dc9a773b84d None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:44.834127 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b86676-cd04-45fc-b909-2dc9a773b84d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:44.834702 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b86676-cd04-45fc-b909-2dc9a773b84d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:44.836114 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b86676-cd04-45fc-b909-2dc9a773b84d None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:44.845234 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-12b86676-cd04-45fc-b909-2dc9a773b84d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 04:01:44.845234 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:44.845234 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:01:44.845234 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:01:44.845234 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:01:44.845234 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:01:44.845234 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:01:44.845234 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:01:44.845234 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 04:01:44.845234 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:44.845234 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:01:44.845234 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:44.845234 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:44.845234 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:44.845234 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:44.845234 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:44.846274 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:44.846274 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:44.846274 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:44.846274 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:44.846274 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:44.846274 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:44.846274 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:44.846274 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:01:44.846274 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:01:44.846274 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:01:44.846274 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:01:44.846274 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:44.846274 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:44.846274 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:44.846274 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:44.846274 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:44.846274 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:44.847613 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:44.847613 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:44.847613 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:44.847613 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:44.847613 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:44.847613 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:44.847613 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:44.847613 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:44.847613 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:44.847613 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:44.847613 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:01:44.847613 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:01:44.847613 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 04:01:44.847613 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:44.847613 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 366/753] 10.222.0.15 () {56 vars in 1132 bytes} [Wed Aug 24 04:01:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:44.854134 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e67a5-0158-4a7f-8828-eaccdccda070 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:44.930133 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:44.962165 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b86676-cd04-45fc-b909-2dc9a773b84d None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:44.978317 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e67a5-0158-4a7f-8828-eaccdccda070 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:44.993989 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:45.021302 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e95f3-f794-4919-b13a-7567a1a725fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:45.021665 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e95f3-f794-4919-b13a-7567a1a725fd None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:45.021890 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e95f3-f794-4919-b13a-7567a1a725fd None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:45.022155 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e95f3-f794-4919-b13a-7567a1a725fd None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:45.022822 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e95f3-f794-4919-b13a-7567a1a725fd None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:45.023086 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e95f3-f794-4919-b13a-7567a1a725fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:45.024498 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e95f3-f794-4919-b13a-7567a1a725fd None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:45.029683 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 388/754] 10.222.0.15 () {56 vars in 1126 bytes} [Wed Aug 24 04:01:44 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:45.035282 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e95f3-f794-4919-b13a-7567a1a725fd None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:45.084796 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b86676-cd04-45fc-b909-2dc9a773b84d None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:45.124742 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd82a5e5-e7b6-4d47-ab11-96971a1cd7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:45.125418 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82a5e5-e7b6-4d47-ab11-96971a1cd7fc None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:45.125700 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82a5e5-e7b6-4d47-ab11-96971a1cd7fc None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:45.125970 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82a5e5-e7b6-4d47-ab11-96971a1cd7fc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:45.126600 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd82a5e5-e7b6-4d47-ab11-96971a1cd7fc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:45.128169 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd82a5e5-e7b6-4d47-ab11-96971a1cd7fc None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:45.137774 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-fd82a5e5-e7b6-4d47-ab11-96971a1cd7fc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 04:01:45.137774 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:45.137774 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:01:45.137774 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:01:45.137774 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:01:45.137774 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:01:45.137774 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:01:45.137774 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:01:45.137774 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 04:01:45.137774 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:45.137774 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:01:45.137774 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:45.137774 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:45.137774 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:45.137774 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:45.137774 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:45.137774 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:45.138924 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:45.138924 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:45.138924 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:45.138924 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:45.138924 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:45.138924 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:45.138924 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:01:45.138924 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:01:45.138924 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:01:45.138924 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:01:45.138924 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:45.138924 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:45.138924 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:45.138924 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:45.138924 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:45.138924 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:45.139795 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:45.139795 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:45.139795 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:45.139795 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:45.139795 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:45.139795 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:45.139795 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:45.139795 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:45.139795 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:45.139795 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:45.139795 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:01:45.139795 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:01:45.139795 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 04:01:45.139795 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:45.143428 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 367/755] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Aug 24 04:01:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:01:45.145168 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd82a5e5-e7b6-4d47-ab11-96971a1cd7fc None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:45.156625 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e95f3-f794-4919-b13a-7567a1a725fd None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:45.189304 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:45.207330 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8bfe3-a14b-4ae5-b214-a337cb495260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:45.208397 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8bfe3-a14b-4ae5-b214-a337cb495260 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:45.208878 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8bfe3-a14b-4ae5-b214-a337cb495260 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:45.209505 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8bfe3-a14b-4ae5-b214-a337cb495260 None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:45.210631 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd8bfe3-a14b-4ae5-b214-a337cb495260 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:45.211148 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd8bfe3-a14b-4ae5-b214-a337cb495260 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:45.213648 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd8bfe3-a14b-4ae5-b214-a337cb495260 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:45.220329 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 389/756] 10.222.0.15 () {56 vars in 1126 bytes} [Wed Aug 24 04:01:45 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:45.267563 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:45.287526 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd82a5e5-e7b6-4d47-ab11-96971a1cd7fc None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:45.343221 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de6fb0-9e94-46f1-bf33-999e22c4f9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:45.346799 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de6fb0-9e94-46f1-bf33-999e22c4f9d5 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:45.347824 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de6fb0-9e94-46f1-bf33-999e22c4f9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:45.348230 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de6fb0-9e94-46f1-bf33-999e22c4f9d5 None admin] PATH_INFO: `/v3/services` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:45.349161 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de6fb0-9e94-46f1-bf33-999e22c4f9d5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:45.349769 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de6fb0-9e94-46f1-bf33-999e22c4f9d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:45.351834 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de6fb0-9e94-46f1-bf33-999e22c4f9d5 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:45.357765 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 368/757] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Aug 24 04:01:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:01:45.364320 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8bfe3-a14b-4ae5-b214-a337cb495260 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:45.482820 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8bfe3-a14b-4ae5-b214-a337cb495260 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:45.519803 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfceb441-0ae3-45b6-8ae3-267a61375f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:45.520418 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfceb441-0ae3-45b6-8ae3-267a61375f13 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:45.520724 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfceb441-0ae3-45b6-8ae3-267a61375f13 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:45.521066 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfceb441-0ae3-45b6-8ae3-267a61375f13 None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:45.521723 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfceb441-0ae3-45b6-8ae3-267a61375f13 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:45.522024 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfceb441-0ae3-45b6-8ae3-267a61375f13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:45.523430 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfceb441-0ae3-45b6-8ae3-267a61375f13 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:45.528656 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 390/758] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Aug 24 04:01:45 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:47.475967 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84622e11-54bf-4f6f-a0bf-e026de26cc68 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:47.476675 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84622e11-54bf-4f6f-a0bf-e026de26cc68 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:47.476675 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84622e11-54bf-4f6f-a0bf-e026de26cc68 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:47.478014 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 369/759] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:01:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:01:47.484941 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d133bd-a98a-4bfd-85e5-9b0c69baa6d8 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:47.485496 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d133bd-a98a-4bfd-85e5-9b0c69baa6d8 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:47.485713 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d133bd-a98a-4bfd-85e5-9b0c69baa6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:47.506691 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-b6d133bd-a98a-4bfd-85e5-9b0c69baa6d8 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:01:47.507968 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-b6d133bd-a98a-4bfd-85e5-9b0c69baa6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:47.562167 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:47.593792 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 391/760] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:01:47 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:01:47.837180 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a70dc-91f2-4cdb-8934-70cc5cb1ee3b None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:47.837582 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a70dc-91f2-4cdb-8934-70cc5cb1ee3b None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:47.837902 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a70dc-91f2-4cdb-8934-70cc5cb1ee3b None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:47.839601 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 370/761] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:01:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:01:47.846091 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d61431-f493-4057-9df3-16ebd65eb906 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:47.846369 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d61431-f493-4057-9df3-16ebd65eb906 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:47.846659 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d61431-f493-4057-9df3-16ebd65eb906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:47.865422 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-56d61431-f493-4057-9df3-16ebd65eb906 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:01:47.866612 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-56d61431-f493-4057-9df3-16ebd65eb906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:47.948663 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a70dc-91f2-4cdb-8934-70cc5cb1ee3b None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:47.962544 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 392/762] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:01:47 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:01:48.073900 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a70dc-91f2-4cdb-8934-70cc5cb1ee3b None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:48.121352 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dff7018-fb12-4120-867e-0322294b10b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:48.122223 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff7018-fb12-4120-867e-0322294b10b6 None admin] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:48.122780 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff7018-fb12-4120-867e-0322294b10b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:48.123171 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff7018-fb12-4120-867e-0322294b10b6 None admin] PATH_INFO: `/v3/services` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:48.124293 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dff7018-fb12-4120-867e-0322294b10b6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:48.125939 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dff7018-fb12-4120-867e-0322294b10b6 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:48.146880 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 371/763] 10.222.0.15 () {60 vars in 1141 bytes} [Wed Aug 24 04:01:47 2022] POST /identity/v3/services => generated 269 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:01:48.305381 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d61431-f493-4057-9df3-16ebd65eb906 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:48.431320 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d61431-f493-4057-9df3-16ebd65eb906 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:48.444456 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:48.480124 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b3876-8780-42de-ae8a-b6ef7bd49c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:48.480739 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b3876-8780-42de-ae8a-b6ef7bd49c91 None admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:48.481019 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b3876-8780-42de-ae8a-b6ef7bd49c91 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:48.481288 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b3876-8780-42de-ae8a-b6ef7bd49c91 None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:48.481935 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40b3876-8780-42de-ae8a-b6ef7bd49c91 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:48.483371 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40b3876-8780-42de-ae8a-b6ef7bd49c91 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:48.507722 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 393/764] 10.222.0.15 () {60 vars in 1141 bytes} [Wed Aug 24 04:01:48 2022] POST /identity/v3/services => generated 251 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:01:50.404751 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281b817-60b5-4f75-a3bd-1a88b6babc01 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:50.405330 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281b817-60b5-4f75-a3bd-1a88b6babc01 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:50.405330 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281b817-60b5-4f75-a3bd-1a88b6babc01 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:50.406640 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 372/765] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:01:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:01:50.415020 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b90af2-8f07-48e6-b559-e01296bd2f84 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:50.415578 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b90af2-8f07-48e6-b559-e01296bd2f84 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:50.415669 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b90af2-8f07-48e6-b559-e01296bd2f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:50.440033 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-d8b90af2-8f07-48e6-b559-e01296bd2f84 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:01:50.441233 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-d8b90af2-8f07-48e6-b559-e01296bd2f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:50.524378 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 394/766] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:01:50 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:01:50.781553 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c6c2a-6674-4a7d-9dbb-a01105adcd29 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:50.781801 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c6c2a-6674-4a7d-9dbb-a01105adcd29 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:50.782005 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c6c2a-6674-4a7d-9dbb-a01105adcd29 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:50.783429 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 373/767] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:01:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:01:50.789472 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ae23e-cb66-428b-a78c-db0c883df36b None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:50.789889 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ae23e-cb66-428b-a78c-db0c883df36b None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:50.790329 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ae23e-cb66-428b-a78c-db0c883df36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:50.811908 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-453ae23e-cb66-428b-a78c-db0c883df36b None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:01:50.813108 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-453ae23e-cb66-428b-a78c-db0c883df36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:50.886643 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 395/768] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:01:50 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:01:50.921492 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c6c2a-6674-4a7d-9dbb-a01105adcd29 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:50.942596 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:51.061340 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c6c2a-6674-4a7d-9dbb-a01105adcd29 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:51.106106 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e2b1b-41bb-4827-9b05-468a1d25a05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:51.106755 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e2b1b-41bb-4827-9b05-468a1d25a05e None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:51.107035 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e2b1b-41bb-4827-9b05-468a1d25a05e None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:51.107353 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e2b1b-41bb-4827-9b05-468a1d25a05e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:51.107996 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599e2b1b-41bb-4827-9b05-468a1d25a05e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:51.109358 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599e2b1b-41bb-4827-9b05-468a1d25a05e None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:51.119882 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-599e2b1b-41bb-4827-9b05-468a1d25a05e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 04:01:51.119882 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:51.119882 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:01:51.119882 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:01:51.119882 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:01:51.119882 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:01:51.119882 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:01:51.119882 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:01:51.119882 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 04:01:51.119882 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:51.119882 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:01:51.119882 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:51.119882 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:51.119882 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:51.119882 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:51.119882 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:51.120954 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:51.120954 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:51.120954 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:51.120954 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:51.120954 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:51.120954 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:51.120954 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:51.120954 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:01:51.120954 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:01:51.120954 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:01:51.120954 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:01:51.120954 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:51.120954 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:51.120954 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:51.120954 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:51.120954 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:51.120954 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:51.121907 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:51.121907 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:51.121907 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:51.121907 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:51.121907 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:51.121907 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:51.121907 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:51.121907 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:51.121907 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:51.121907 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:51.121907 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:01:51.121907 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:01:51.121907 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 04:01:51.121907 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:51.121907 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 374/769] 10.222.0.15 () {56 vars in 1132 bytes} [Wed Aug 24 04:01:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:51.133334 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ae23e-cb66-428b-a78c-db0c883df36b None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:51.170967 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:51.229219 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e2b1b-41bb-4827-9b05-468a1d25a05e None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:51.264865 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ae23e-cb66-428b-a78c-db0c883df36b None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:51.301595 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d22715e-47d6-4c58-b5e6-8938e9e48a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:51.302264 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22715e-47d6-4c58-b5e6-8938e9e48a06 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:51.302538 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22715e-47d6-4c58-b5e6-8938e9e48a06 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:51.302804 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22715e-47d6-4c58-b5e6-8938e9e48a06 None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:51.303469 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d22715e-47d6-4c58-b5e6-8938e9e48a06 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:51.303768 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d22715e-47d6-4c58-b5e6-8938e9e48a06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:51.305483 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d22715e-47d6-4c58-b5e6-8938e9e48a06 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:51.311591 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 396/770] 10.222.0.15 () {56 vars in 1126 bytes} [Wed Aug 24 04:01:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:51.318589 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d22715e-47d6-4c58-b5e6-8938e9e48a06 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:51.342844 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:51.392164 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e2b1b-41bb-4827-9b05-468a1d25a05e None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:51.435857 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:51.447051 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d7e48-51ea-4577-a5e8-12a08c743053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:51.448069 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d7e48-51ea-4577-a5e8-12a08c743053 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:51.448611 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d7e48-51ea-4577-a5e8-12a08c743053 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:51.449076 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d7e48-51ea-4577-a5e8-12a08c743053 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:51.449917 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664d7e48-51ea-4577-a5e8-12a08c743053 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:51.451410 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664d7e48-51ea-4577-a5e8-12a08c743053 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:51.455143 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d22715e-47d6-4c58-b5e6-8938e9e48a06 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:51.461902 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-664d7e48-51ea-4577-a5e8-12a08c743053 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 04:01:51.461902 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:51.461902 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:01:51.461902 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:01:51.461902 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:01:51.461902 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:01:51.461902 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:01:51.461902 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:01:51.461902 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 04:01:51.461902 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:51.461902 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:01:51.461902 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:51.461902 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:51.461902 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:51.461902 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:51.461902 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:51.461902 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:51.462961 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:51.462961 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:51.462961 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:51.462961 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:51.462961 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:51.462961 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:51.462961 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:01:51.462961 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:01:51.462961 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:01:51.462961 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:01:51.462961 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:51.462961 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:51.462961 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:51.462961 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:51.462961 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:51.462961 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:51.468136 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:51.468136 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:51.468136 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:51.468136 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:51.468136 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:51.468136 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:51.468136 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:51.468136 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:51.468136 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:51.468136 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:51.468136 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:01:51.468136 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:01:51.468136 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 04:01:51.468136 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:51.468136 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 375/771] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Aug 24 04:01:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:01:51.470715 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d7e48-51ea-4577-a5e8-12a08c743053 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:51.495113 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc679d6-521c-4b45-a19d-50ef879e60b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:51.495749 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc679d6-521c-4b45-a19d-50ef879e60b0 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:51.496026 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc679d6-521c-4b45-a19d-50ef879e60b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:51.496297 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc679d6-521c-4b45-a19d-50ef879e60b0 None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:51.496933 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc679d6-521c-4b45-a19d-50ef879e60b0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:51.497231 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc679d6-521c-4b45-a19d-50ef879e60b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:51.498770 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc679d6-521c-4b45-a19d-50ef879e60b0 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:51.504731 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 397/772] 10.222.0.15 () {56 vars in 1126 bytes} [Wed Aug 24 04:01:51 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:01:51.512006 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc679d6-521c-4b45-a19d-50ef879e60b0 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:51.620651 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d7e48-51ea-4577-a5e8-12a08c743053 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:51.638028 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc679d6-521c-4b45-a19d-50ef879e60b0 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:51.670361 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463d203-3a95-45a9-be0b-dbb5c3de6eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:51.671006 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463d203-3a95-45a9-be0b-dbb5c3de6eae None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:51.671340 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463d203-3a95-45a9-be0b-dbb5c3de6eae None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:51.671610 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463d203-3a95-45a9-be0b-dbb5c3de6eae None admin] PATH_INFO: `/v3/services` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:51.672528 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d463d203-3a95-45a9-be0b-dbb5c3de6eae None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:51.672991 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d463d203-3a95-45a9-be0b-dbb5c3de6eae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:51.674729 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d463d203-3a95-45a9-be0b-dbb5c3de6eae None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:51.677083 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:51.681806 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f7668-02b4-400f-971a-3c1aed12bb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:51.682420 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f7668-02b4-400f-971a-3c1aed12bb0a None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:51.682700 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f7668-02b4-400f-971a-3c1aed12bb0a None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:51.682973 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f7668-02b4-400f-971a-3c1aed12bb0a None admin] PATH_INFO: `/v3/endpoints` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:51.683711 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f7668-02b4-400f-971a-3c1aed12bb0a None admin] RBAC: Adding query filter params (interface=public, service_id=2ac665b24cda4b489ae6f63316898b2e, region_id=RegionOne) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:51.684021 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f7668-02b4-400f-971a-3c1aed12bb0a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:51.684452 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 376/773] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Aug 24 04:01:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:51.685410 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f7668-02b4-400f-971a-3c1aed12bb0a None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:51.698689 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 398/774] 10.222.0.15 () {56 vars in 1251 bytes} [Wed Aug 24 04:01:51 2022] GET /identity/v3/endpoints?service_id=2ac665b24cda4b489ae6f63316898b2e&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:01:51.698976 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463d203-3a95-45a9-be0b-dbb5c3de6eae None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:51.699861 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f7668-02b4-400f-971a-3c1aed12bb0a None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:51.718926 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:51.819402 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463d203-3a95-45a9-be0b-dbb5c3de6eae None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:51.821993 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f7668-02b4-400f-971a-3c1aed12bb0a None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:51.860018 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ad05b-bc1e-4f1d-9fba-40ff1a317483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:51.860633 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ad05b-bc1e-4f1d-9fba-40ff1a317483 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:51.860906 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146a9d8-0715-498f-bea4-b080d70c04d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:51.861139 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ad05b-bc1e-4f1d-9fba-40ff1a317483 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:51.861322 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ad05b-bc1e-4f1d-9fba-40ff1a317483 None admin] PATH_INFO: `/v3/services` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:51.861488 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146a9d8-0715-498f-bea4-b080d70c04d8 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:51.861812 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146a9d8-0715-498f-bea4-b080d70c04d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:51.861980 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ad05b-bc1e-4f1d-9fba-40ff1a317483 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:51.862132 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146a9d8-0715-498f-bea4-b080d70c04d8 None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:51.862297 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ad05b-bc1e-4f1d-9fba-40ff1a317483 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:51.862674 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146a9d8-0715-498f-bea4-b080d70c04d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:51.863682 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ad05b-bc1e-4f1d-9fba-40ff1a317483 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:51.864055 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146a9d8-0715-498f-bea4-b080d70c04d8 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:51.869297 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 377/775] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Aug 24 04:01:51 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:51.871293 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 399/776] 10.222.0.15 () {56 vars in 1087 bytes} [Wed Aug 24 04:01:51 2022] GET /identity/v3/services => generated 1498 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:01:51.875752 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ad05b-bc1e-4f1d-9fba-40ff1a317483 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:51.965412 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:52.016695 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ad05b-bc1e-4f1d-9fba-40ff1a317483 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:52.060499 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504f66e-6891-4c45-adea-c31cdadc858f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:52.061119 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504f66e-6891-4c45-adea-c31cdadc858f None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:52.061394 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504f66e-6891-4c45-adea-c31cdadc858f None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:52.061853 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504f66e-6891-4c45-adea-c31cdadc858f None admin] PATH_INFO: `/v3/endpoints` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:52.062704 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c504f66e-6891-4c45-adea-c31cdadc858f None admin] RBAC: Adding query filter params (interface=public, service_id=5774a0c8acb7454b9ba455baf9fa4ebc, region_id=RegionOne) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:52.063147 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c504f66e-6891-4c45-adea-c31cdadc858f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:52.064805 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c504f66e-6891-4c45-adea-c31cdadc858f None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:52.072470 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 378/777] 10.222.0.15 () {56 vars in 1251 bytes} [Wed Aug 24 04:01:51 2022] GET /identity/v3/endpoints?service_id=5774a0c8acb7454b9ba455baf9fa4ebc&interface=public®ion_id=RegionOne => generated 194 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:01:52.077157 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146a9d8-0715-498f-bea4-b080d70c04d8 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:52.182039 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:52.205331 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146a9d8-0715-498f-bea4-b080d70c04d8 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:52.239746 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d0ebbc-a7fe-4793-bbca-ead0c9052ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:52.240359 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0ebbc-a7fe-4793-bbca-ead0c9052ecd None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:52.240641 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0ebbc-a7fe-4793-bbca-ead0c9052ecd None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:52.240914 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d0ebbc-a7fe-4793-bbca-ead0c9052ecd None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:52.241598 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d0ebbc-a7fe-4793-bbca-ead0c9052ecd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:52.243064 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d0ebbc-a7fe-4793-bbca-ead0c9052ecd None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:52.250060 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 400/778] 10.222.0.15 () {56 vars in 1087 bytes} [Wed Aug 24 04:01:52 2022] GET /identity/v3/services => generated 1498 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:01:54.132100 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88b186-1094-4ad3-8cf9-0861fd81f596 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:54.132665 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88b186-1094-4ad3-8cf9-0861fd81f596 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:54.133142 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88b186-1094-4ad3-8cf9-0861fd81f596 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:54.135172 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 379/779] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:01:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:01:54.141574 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd988bc6-1e18-417d-b286-3a930414bd36 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:54.142272 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd988bc6-1e18-417d-b286-3a930414bd36 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:54.142272 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd988bc6-1e18-417d-b286-3a930414bd36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:54.165464 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-dd988bc6-1e18-417d-b286-3a930414bd36 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:01:54.166704 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-dd988bc6-1e18-417d-b286-3a930414bd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:54.253110 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 401/780] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:01:54 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:01:54.509628 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286b6af-278a-4625-a4cd-c0b271a7b418 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:54.509876 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286b6af-278a-4625-a4cd-c0b271a7b418 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:54.510074 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286b6af-278a-4625-a4cd-c0b271a7b418 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:54.511686 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 380/781] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:01:54.516890 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1530e25-3b79-4b96-b368-1782a64545f9 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:54.517172 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1530e25-3b79-4b96-b368-1782a64545f9 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:54.517448 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1530e25-3b79-4b96-b368-1782a64545f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:54.544629 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-c1530e25-3b79-4b96-b368-1782a64545f9 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:01:54.546006 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-c1530e25-3b79-4b96-b368-1782a64545f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:54.588011 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5286b6af-278a-4625-a4cd-c0b271a7b418 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:54.623472 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 402/782] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:01:54 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:01:54.702112 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5286b6af-278a-4625-a4cd-c0b271a7b418 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:54.730326 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:54.740752 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bc129-1bd9-4f8a-b71f-753083aa7244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:54.741498 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bc129-1bd9-4f8a-b71f-753083aa7244 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:54.741873 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bc129-1bd9-4f8a-b71f-753083aa7244 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:54.742233 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bc129-1bd9-4f8a-b71f-753083aa7244 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:54.742910 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9bc129-1bd9-4f8a-b71f-753083aa7244 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:54.744443 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9bc129-1bd9-4f8a-b71f-753083aa7244 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:54.755033 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-ef9bc129-1bd9-4f8a-b71f-753083aa7244 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 04:01:54.755033 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:54.755033 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:01:54.755033 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:01:54.755033 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:01:54.755033 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:01:54.755033 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:01:54.755033 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:01:54.755033 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 04:01:54.755033 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:54.755033 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:01:54.755033 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:54.755033 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:54.755033 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:54.755033 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:54.755033 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:54.756861 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:54.756861 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:54.756861 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:54.756861 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:54.756861 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:54.756861 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:54.756861 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:54.756861 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:01:54.756861 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:01:54.756861 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:01:54.756861 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:01:54.756861 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:54.756861 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:54.756861 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:54.756861 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:54.756861 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:54.756861 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:54.757830 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:54.757830 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:54.757830 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:54.757830 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:54.757830 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:54.757830 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:54.757830 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:54.757830 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:54.757830 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:54.757830 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:54.757830 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:01:54.757830 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:01:54.757830 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 04:01:54.757830 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:54.757830 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 381/783] 10.222.0.15 () {56 vars in 1132 bytes} [Wed Aug 24 04:01:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:01:54.763635 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1530e25-3b79-4b96-b368-1782a64545f9 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:54.768111 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:54.884422 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1530e25-3b79-4b96-b368-1782a64545f9 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:54.929729 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a3584-860a-400c-9e46-a6926fbc4938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:54.930347 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a3584-860a-400c-9e46-a6926fbc4938 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:54.930684 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a3584-860a-400c-9e46-a6926fbc4938 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:54.930984 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a3584-860a-400c-9e46-a6926fbc4938 None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:54.931826 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a3584-860a-400c-9e46-a6926fbc4938 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:54.932130 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a3584-860a-400c-9e46-a6926fbc4938 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:54.934610 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a3584-860a-400c-9e46-a6926fbc4938 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:54.943490 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 403/784] 10.222.0.15 () {56 vars in 1126 bytes} [Wed Aug 24 04:01:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:54.948598 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bc129-1bd9-4f8a-b71f-753083aa7244 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:54.968504 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a3584-860a-400c-9e46-a6926fbc4938 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:55.052299 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:55.075701 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bc129-1bd9-4f8a-b71f-753083aa7244 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:55.093564 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a3584-860a-400c-9e46-a6926fbc4938 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:55.119287 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804bb35a-94a7-4c8f-a38e-0a58e8583734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:55.120059 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bb35a-94a7-4c8f-a38e-0a58e8583734 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:55.120332 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bb35a-94a7-4c8f-a38e-0a58e8583734 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:55.120597 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bb35a-94a7-4c8f-a38e-0a58e8583734 None admin] PATH_INFO: `/v3/services` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:55.121403 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804bb35a-94a7-4c8f-a38e-0a58e8583734 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:55.121705 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804bb35a-94a7-4c8f-a38e-0a58e8583734 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:55.123593 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804bb35a-94a7-4c8f-a38e-0a58e8583734 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:55.129850 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 382/785] 10.222.0.15 () {56 vars in 1126 bytes} [Wed Aug 24 04:01:54 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:55.136361 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804bb35a-94a7-4c8f-a38e-0a58e8583734 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:55.140106 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b357bfd-3aed-45b2-8fad-d7bb1fb74be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:55.140793 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b357bfd-3aed-45b2-8fad-d7bb1fb74be7 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:55.141217 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b357bfd-3aed-45b2-8fad-d7bb1fb74be7 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:55.141533 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b357bfd-3aed-45b2-8fad-d7bb1fb74be7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:55.142215 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b357bfd-3aed-45b2-8fad-d7bb1fb74be7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:55.143813 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b357bfd-3aed-45b2-8fad-d7bb1fb74be7 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:55.155699 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-6b357bfd-3aed-45b2-8fad-d7bb1fb74be7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 04:01:55.155699 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:55.155699 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:01:55.155699 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:01:55.155699 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:01:55.155699 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:01:55.155699 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:01:55.155699 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:01:55.155699 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 04:01:55.155699 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:55.155699 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:01:55.155699 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:55.155699 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:55.155699 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:55.155699 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:55.155699 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:55.155699 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:55.157021 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:55.157021 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:55.157021 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:55.157021 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:55.157021 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:55.157021 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:55.157021 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:01:55.157021 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:01:55.157021 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:01:55.157021 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:01:55.157021 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:55.157021 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:55.157021 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:55.157021 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:55.157021 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:55.157021 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:55.157861 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:55.157861 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:55.157861 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:55.157861 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:55.157861 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:55.157861 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:55.157861 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:55.157861 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:55.157861 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:55.157861 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:55.157861 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:01:55.157861 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:01:55.157861 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 04:01:55.157861 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:55.157861 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 404/786] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Aug 24 04:01:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:55.164533 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b357bfd-3aed-45b2-8fad-d7bb1fb74be7 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:55.213862 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:55.266441 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804bb35a-94a7-4c8f-a38e-0a58e8583734 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:55.298720 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b357bfd-3aed-45b2-8fad-d7bb1fb74be7 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:55.308186 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda20dc-04fa-41fe-9ac4-0369c55faf5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:55.308703 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda20dc-04fa-41fe-9ac4-0369c55faf5b None admin] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:55.308994 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda20dc-04fa-41fe-9ac4-0369c55faf5b None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:55.309278 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda20dc-04fa-41fe-9ac4-0369c55faf5b None admin] PATH_INFO: `/v3/endpoints` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:55.309958 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda20dc-04fa-41fe-9ac4-0369c55faf5b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:55.311505 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda20dc-04fa-41fe-9ac4-0369c55faf5b None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:55.334800 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 383/787] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 24 04:01:55 2022] POST /identity/v3/endpoints => generated 347 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:01:55.343013 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:55.357082 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70713fea-8939-4220-98d3-96d1779f9b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:55.357681 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70713fea-8939-4220-98d3-96d1779f9b5e None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:55.357975 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70713fea-8939-4220-98d3-96d1779f9b5e None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:55.358245 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70713fea-8939-4220-98d3-96d1779f9b5e None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:55.358894 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70713fea-8939-4220-98d3-96d1779f9b5e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:55.359219 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70713fea-8939-4220-98d3-96d1779f9b5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:55.360663 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70713fea-8939-4220-98d3-96d1779f9b5e None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:55.366601 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 405/788] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Aug 24 04:01:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:55.372826 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda20dc-04fa-41fe-9ac4-0369c55faf5b None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:55.490995 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda20dc-04fa-41fe-9ac4-0369c55faf5b None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:55.507411 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:55.541187 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d66241-0561-423e-9c76-acfd154460ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:55.541900 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d66241-0561-423e-9c76-acfd154460ca None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:55.542248 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d66241-0561-423e-9c76-acfd154460ca None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:55.542518 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d66241-0561-423e-9c76-acfd154460ca None admin] PATH_INFO: `/v3/services` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:55.543314 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d66241-0561-423e-9c76-acfd154460ca None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:55.543643 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d66241-0561-423e-9c76-acfd154460ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:55.545548 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d66241-0561-423e-9c76-acfd154460ca None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:55.552389 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 384/789] 10.222.0.15 () {56 vars in 1114 bytes} [Wed Aug 24 04:01:55 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:55.560300 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70713fea-8939-4220-98d3-96d1779f9b5e None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:55.708089 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70713fea-8939-4220-98d3-96d1779f9b5e None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:55.743472 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b977fe1-bb27-4837-9ec3-510409b54d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:55.744071 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b977fe1-bb27-4837-9ec3-510409b54d09 None admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:55.744344 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b977fe1-bb27-4837-9ec3-510409b54d09 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:55.744614 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b977fe1-bb27-4837-9ec3-510409b54d09 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:55.745284 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b977fe1-bb27-4837-9ec3-510409b54d09 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:55.746666 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b977fe1-bb27-4837-9ec3-510409b54d09 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:55.768930 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 406/790] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 24 04:01:55 2022] POST /identity/v3/endpoints => generated 346 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:01:57.728027 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba8345-1adb-4754-9b3c-172187a1a051 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:57.728587 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba8345-1adb-4754-9b3c-172187a1a051 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:57.728587 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba8345-1adb-4754-9b3c-172187a1a051 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:57.729886 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 385/791] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:01:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:01:57.735530 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173efa9-d42b-4f9e-8762-5b9664ac84ea None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:57.736022 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173efa9-d42b-4f9e-8762-5b9664ac84ea None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:57.736167 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173efa9-d42b-4f9e-8762-5b9664ac84ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:57.756057 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-6173efa9-d42b-4f9e-8762-5b9664ac84ea None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:01:57.757306 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-6173efa9-d42b-4f9e-8762-5b9664ac84ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:57.809051 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:57.848105 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 407/792] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:01:57 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:01:58.073240 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ae264-f2ce-49d3-9d6a-7adfb89831ae None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:58.073487 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ae264-f2ce-49d3-9d6a-7adfb89831ae None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:58.073775 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ae264-f2ce-49d3-9d6a-7adfb89831ae None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:58.075113 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 386/793] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:01:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:01:58.080508 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b689c-a839-40d4-b821-07edeeaa64f7 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:58.080888 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b689c-a839-40d4-b821-07edeeaa64f7 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:58.081230 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b689c-a839-40d4-b821-07edeeaa64f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:58.101063 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-c87b689c-a839-40d4-b821-07edeeaa64f7 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:01:58.102491 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-c87b689c-a839-40d4-b821-07edeeaa64f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:58.177012 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 408/794] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:01:58 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:01:58.183714 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ae264-f2ce-49d3-9d6a-7adfb89831ae None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:58.304303 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ae264-f2ce-49d3-9d6a-7adfb89831ae None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:58.340154 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2a5fd-f2c5-477e-8816-6cca07c173ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:58.340686 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2a5fd-f2c5-477e-8816-6cca07c173ec None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:58.340961 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2a5fd-f2c5-477e-8816-6cca07c173ec None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:58.341231 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2a5fd-f2c5-477e-8816-6cca07c173ec None admin] PATH_INFO: `/v3/services/compute` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:58.341810 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2a5fd-f2c5-477e-8816-6cca07c173ec None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:58.343219 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2a5fd-f2c5-477e-8816-6cca07c173ec None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:58.352821 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-4cc2a5fd-f2c5-477e-8816-6cca07c173ec None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 04:01:58.352821 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:58.352821 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:01:58.352821 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:01:58.352821 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:01:58.352821 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:01:58.352821 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:01:58.352821 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:01:58.352821 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 04:01:58.352821 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:58.352821 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:01:58.352821 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:58.352821 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:58.352821 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:58.352821 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:58.352821 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:58.352821 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:58.353932 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:58.353932 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:58.353932 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:58.353932 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:58.353932 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:58.353932 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:58.353932 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:01:58.353932 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:01:58.353932 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:01:58.353932 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:01:58.353932 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:58.353932 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:58.353932 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:58.353932 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:58.353932 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:58.353932 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:58.354849 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:58.354849 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:58.354849 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:58.354849 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:58.354849 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:58.354849 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:58.354849 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:58.354849 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:58.354849 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:58.354849 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:58.354849 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:01:58.354849 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:01:58.354849 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 04:01:58.354849 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:58.354849 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 387/795] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 24 04:01:58 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:58.360113 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b689c-a839-40d4-b821-07edeeaa64f7 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:58.462581 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b689c-a839-40d4-b821-07edeeaa64f7 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:58.464135 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:58.497309 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcad3b2-1022-4ec2-83a9-e7e06981ab1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:58.497908 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcad3b2-1022-4ec2-83a9-e7e06981ab1d None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:58.498182 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcad3b2-1022-4ec2-83a9-e7e06981ab1d None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:58.498451 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcad3b2-1022-4ec2-83a9-e7e06981ab1d None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:58.499126 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcad3b2-1022-4ec2-83a9-e7e06981ab1d None admin] RBAC: Adding query filter params (name=compute) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:58.499453 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcad3b2-1022-4ec2-83a9-e7e06981ab1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:58.500067 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2a5fd-f2c5-477e-8816-6cca07c173ec None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:58.500885 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcad3b2-1022-4ec2-83a9-e7e06981ab1d None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:58.505746 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 409/796] 10.222.0.15 () {56 vars in 1112 bytes} [Wed Aug 24 04:01:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:01:58.511455 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcad3b2-1022-4ec2-83a9-e7e06981ab1d None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:58.542615 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:58.601758 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2a5fd-f2c5-477e-8816-6cca07c173ec None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:58.615317 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcad3b2-1022-4ec2-83a9-e7e06981ab1d None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:58.636114 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef032fc-c6c0-4d12-b0c8-6ebdc7919823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:58.636718 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef032fc-c6c0-4d12-b0c8-6ebdc7919823 None admin] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:58.636990 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef032fc-c6c0-4d12-b0c8-6ebdc7919823 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:58.637256 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef032fc-c6c0-4d12-b0c8-6ebdc7919823 None admin] PATH_INFO: `/v3/projects` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:58.637904 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef032fc-c6c0-4d12-b0c8-6ebdc7919823 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:58.639368 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef032fc-c6c0-4d12-b0c8-6ebdc7919823 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:58.641993 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: WARNING keystone.server.flask.common [None req-aef032fc-c6c0-4d12-b0c8-6ebdc7919823 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 04:01:58.654183 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187034fd-6152-41f6-aec8-6da9247b54f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:58.654757 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187034fd-6152-41f6-aec8-6da9247b54f1 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:58.655036 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187034fd-6152-41f6-aec8-6da9247b54f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:58.655472 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187034fd-6152-41f6-aec8-6da9247b54f1 None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:58.656141 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187034fd-6152-41f6-aec8-6da9247b54f1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:58.656778 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187034fd-6152-41f6-aec8-6da9247b54f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:58.658286 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187034fd-6152-41f6-aec8-6da9247b54f1 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:58.659992 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.sql.core [None req-aef032fc-c6c0-4d12-b0c8-6ebdc7919823 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 04:01:58.659992 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 04:01:58.659992 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [parameters: {'id': 'f64587ed76684627b1ada58f8b088077', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 04:01:58.659992 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88432) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 04:01:58.663342 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 410/797] 10.222.0.15 () {56 vars in 1112 bytes} [Wed Aug 24 04:01:58 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:01:58.676513 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-aef032fc-c6c0-4d12-b0c8-6ebdc7919823 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f64587ed76684627b1ada58f8b088077.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f64587ed76684627b1ada58f8b088077. Aug 24 04:01:58.676513 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:58.676513 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 04:01:58.676513 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 04:01:58.676513 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 04:01:58.676513 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 04:01:58.676513 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 04:01:58.676513 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 04:01:58.676513 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 04:01:58.676513 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application conn.query(q) Aug 24 04:01:58.676513 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 04:01:58.676513 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 04:01:58.676513 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 04:01:58.677447 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application result.read() Aug 24 04:01:58.677447 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 04:01:58.677447 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 04:01:58.677447 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 04:01:58.677447 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 04:01:58.677447 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 04:01:58.677447 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 04:01:58.677447 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 04:01:58.677447 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 04:01:58.677447 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 04:01:58.677447 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:58.677447 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 04:01:58.677447 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:58.677447 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:58.677447 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 04:01:58.677447 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 04:01:58.677447 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 24 04:01:58.677447 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 24 04:01:58.678405 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 04:01:58.678405 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application next(self.gen) Aug 24 04:01:58.678405 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 04:01:58.678405 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application yield resource Aug 24 04:01:58.678405 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 04:01:58.678405 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application next(self.gen) Aug 24 04:01:58.678405 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 04:01:58.678405 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 04:01:58.678405 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 04:01:58.678405 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 04:01:58.678405 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 04:01:58.678405 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise self.value Aug 24 04:01:58.678405 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 04:01:58.678405 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 04:01:58.678405 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 04:01:58.678405 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application session.commit() Aug 24 04:01:58.678405 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 04:01:58.679817 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 04:01:58.679817 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 04:01:58.679817 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 04:01:58.679817 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 04:01:58.679817 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application self.session.flush() Aug 24 04:01:58.679817 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 04:01:58.679817 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 04:01:58.679817 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 04:01:58.679817 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 04:01:58.679817 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 04:01:58.679817 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application compat.raise_( Aug 24 04:01:58.679817 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 04:01:58.679817 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception Aug 24 04:01:58.679817 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 04:01:58.679817 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 04:01:58.679817 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 04:01:58.679817 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 04:01:58.680734 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 04:01:58.680734 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 04:01:58.680734 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 04:01:58.680734 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 04:01:58.680734 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 04:01:58.680734 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 04:01:58.680734 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 04:01:58.680734 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 04:01:58.680734 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 04:01:58.680734 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 04:01:58.680734 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 04:01:58.680734 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 04:01:58.680734 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 04:01:58.680734 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 04:01:58.680734 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 04:01:58.681567 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 04:01:58.681567 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 04:01:58.681567 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception Aug 24 04:01:58.681567 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 04:01:58.681567 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 04:01:58.681567 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 04:01:58.681567 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 04:01:58.681567 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 04:01:58.681567 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 04:01:58.681567 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 04:01:58.681567 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application conn.query(q) Aug 24 04:01:58.681567 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 04:01:58.681567 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 04:01:58.681567 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 04:01:58.681567 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application result.read() Aug 24 04:01:58.681567 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 04:01:58.681567 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 04:01:58.682454 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 04:01:58.682454 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 04:01:58.682454 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 04:01:58.682454 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 04:01:58.682454 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 04:01:58.682454 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 04:01:58.682454 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 04:01:58.682454 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 04:01:58.682454 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [parameters: {'id': 'f64587ed76684627b1ada58f8b088077', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 04:01:58.682454 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 04:01:58.682454 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:58.682454 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:01:58.682454 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:58.682454 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:58.682454 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 24 04:01:58.683719 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 24 04:01:58.683719 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 04:01:58.683719 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 04:01:58.683719 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 24 04:01:58.683719 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:58.683719 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:01:58.683719 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:58.683719 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:58.683719 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:58.683719 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:58.683719 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:58.683719 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:58.683719 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:58.683719 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:58.683719 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:58.683719 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:58.683719 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:58.684997 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:58.684997 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 24 04:01:58.684997 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 24 04:01:58.684997 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:58.684997 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:58.684997 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 24 04:01:58.684997 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 24 04:01:58.684997 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f64587ed76684627b1ada58f8b088077. Aug 24 04:01:58.684997 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:01:58.684997 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 388/798] 10.222.0.15 () {60 vars in 1140 bytes} [Wed Aug 24 04:01:58 2022] POST /identity/v3/projects => generated 262 bytes in 180 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:01:58.685738 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187034fd-6152-41f6-aec8-6da9247b54f1 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:58.724641 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:58.806718 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187034fd-6152-41f6-aec8-6da9247b54f1 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:58.843295 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80aa6a3-0380-42da-a7ad-24b87f52d510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:58.843933 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80aa6a3-0380-42da-a7ad-24b87f52d510 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:58.844213 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80aa6a3-0380-42da-a7ad-24b87f52d510 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:58.844484 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80aa6a3-0380-42da-a7ad-24b87f52d510 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:58.851841 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80aa6a3-0380-42da-a7ad-24b87f52d510 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:58.853240 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80aa6a3-0380-42da-a7ad-24b87f52d510 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:58.865866 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-d80aa6a3-0380-42da-a7ad-24b87f52d510 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:01:58.865866 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:01:58.865866 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:01:58.865866 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:01:58.865866 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:01:58.865866 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:01:58.865866 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:01:58.865866 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:01:58.865866 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:01:58.865866 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:01:58.865866 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:01:58.865866 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:01:58.865866 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:01:58.865866 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:01:58.865866 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:01:58.866892 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:01:58.866892 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:01:58.866892 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:01:58.866892 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:01:58.866892 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:01:58.866892 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:01:58.866892 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:01:58.866892 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:01:58.866892 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:01:58.866892 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:01:58.866892 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:01:58.866892 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:01:58.866892 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:01:58.866892 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:01:58.866892 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:01:58.866892 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:01:58.866892 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:01:58.867801 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:01:58.867801 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:01:58.867801 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:01:58.867801 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:01:58.867801 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:01:58.867801 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:01:58.867801 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:01:58.867801 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:01:58.867801 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 411/799] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 24 04:01:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:01:58.873995 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef032fc-c6c0-4d12-b0c8-6ebdc7919823 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:58.997224 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:59.005123 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef032fc-c6c0-4d12-b0c8-6ebdc7919823 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:59.044205 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4bf28-4603-4b9e-a21d-dd71b889cd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:59.044822 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4bf28-4603-4b9e-a21d-dd71b889cd29 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:59.045097 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4bf28-4603-4b9e-a21d-dd71b889cd29 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:59.045353 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4bf28-4603-4b9e-a21d-dd71b889cd29 None admin] PATH_INFO: `/v3/projects` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:59.046032 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca4bf28-4603-4b9e-a21d-dd71b889cd29 None admin] RBAC: Adding query filter params (name=service) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:01:59.046324 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca4bf28-4603-4b9e-a21d-dd71b889cd29 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:59.048010 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca4bf28-4603-4b9e-a21d-dd71b889cd29 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:59.069065 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 389/800] 10.222.0.15 () {56 vars in 1112 bytes} [Wed Aug 24 04:01:58 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:02:00.841738 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff13ce-b272-4dc3-83f4-1e05af4a33b1 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:02:00.842280 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff13ce-b272-4dc3-83f4-1e05af4a33b1 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:02:00.842280 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff13ce-b272-4dc3-83f4-1e05af4a33b1 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:02:00.843672 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 412/801] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:02:00.849352 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c5678-bcd0-486d-89f3-f7dd38ea2df0 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:02:00.849824 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c5678-bcd0-486d-89f3-f7dd38ea2df0 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:02:00.849911 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c5678-bcd0-486d-89f3-f7dd38ea2df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:02:00.869981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-813c5678-bcd0-486d-89f3-f7dd38ea2df0 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:02:00.871576 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-813c5678-bcd0-486d-89f3-f7dd38ea2df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:02:00.943856 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 390/802] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:02:00 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:02:01.268831 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff13ce-b272-4dc3-83f4-1e05af4a33b1 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:02:01.324428 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3f085-318c-434d-b3f5-e9271af8ba9f None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:02:01.324805 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3f085-318c-434d-b3f5-e9271af8ba9f None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:02:01.325100 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3f085-318c-434d-b3f5-e9271af8ba9f None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:02:01.326418 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 391/803] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:02:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:02:01.331635 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c4dc8-0b18-443d-a578-daab1232a0c7 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:02:01.331918 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c4dc8-0b18-443d-a578-daab1232a0c7 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:02:01.332192 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c4dc8-0b18-443d-a578-daab1232a0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:02:01.350936 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-a84c4dc8-0b18-443d-a578-daab1232a0c7 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:02:01.352177 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-a84c4dc8-0b18-443d-a578-daab1232a0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:02:01.365118 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:02:01.377259 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff13ce-b272-4dc3-83f4-1e05af4a33b1 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:02:01.412750 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae507468-4ce4-4269-b090-3e8d2a204bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:02:01.413358 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae507468-4ce4-4269-b090-3e8d2a204bf7 None admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:02:01.413629 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae507468-4ce4-4269-b090-3e8d2a204bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:02:01.413895 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae507468-4ce4-4269-b090-3e8d2a204bf7 None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:02:01.414530 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae507468-4ce4-4269-b090-3e8d2a204bf7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:02:01.415926 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae507468-4ce4-4269-b090-3e8d2a204bf7 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:02:01.420258 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 392/804] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:02:01 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:02:01.430710 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 413/805] 10.222.0.15 () {60 vars in 1141 bytes} [Wed Aug 24 04:02:01 2022] POST /identity/v3/services => generated 242 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:02:01.744055 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c4dc8-0b18-443d-a578-daab1232a0c7 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:02:01.763548 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:02:01.850643 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c4dc8-0b18-443d-a578-daab1232a0c7 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:02:01.892060 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec0c8d-380e-4c46-b254-2fe5c23dd055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:02:01.892674 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec0c8d-380e-4c46-b254-2fe5c23dd055 None admin] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:02:01.892950 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec0c8d-380e-4c46-b254-2fe5c23dd055 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:02:01.893219 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec0c8d-380e-4c46-b254-2fe5c23dd055 None admin] PATH_INFO: `/v3/users` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:02:01.893847 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ec0c8d-380e-4c46-b254-2fe5c23dd055 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:02:01.895316 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ec0c8d-380e-4c46-b254-2fe5c23dd055 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:02:01.910396 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.sql.core [None req-13ec0c8d-380e-4c46-b254-2fe5c23dd055 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 04:02:01.910396 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 04:02:01.910396 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [parameters: {'user_id': 'd08241e436b943d9ae56dad29b66093f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 04:02:01.910396 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88432) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 04:02:01.917312 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-13ec0c8d-380e-4c46-b254-2fe5c23dd055 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 04:02:01.917312 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:02:01.917312 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 04:02:01.917312 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 04:02:01.917312 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 04:02:01.917312 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 04:02:01.917312 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 04:02:01.917312 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 04:02:01.917312 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 04:02:01.917312 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application conn.query(q) Aug 24 04:02:01.917312 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 04:02:01.917312 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 04:02:01.917312 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 04:02:01.917312 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application result.read() Aug 24 04:02:01.917312 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 04:02:01.918196 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 04:02:01.918196 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 04:02:01.918196 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 04:02:01.918196 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 04:02:01.918196 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 04:02:01.918196 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 04:02:01.918196 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 04:02:01.918196 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 04:02:01.918196 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:02:01.918196 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 04:02:01.918196 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:02:01.918196 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:02:01.918196 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 04:02:01.918196 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 04:02:01.918196 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 24 04:02:01.918196 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 24 04:02:01.918196 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 04:02:01.918196 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application next(self.gen) Aug 24 04:02:01.919130 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 04:02:01.919130 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application yield resource Aug 24 04:02:01.919130 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 04:02:01.919130 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application next(self.gen) Aug 24 04:02:01.919130 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 04:02:01.919130 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 04:02:01.919130 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 04:02:01.919130 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 04:02:01.919130 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 04:02:01.919130 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise self.value Aug 24 04:02:01.919130 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 04:02:01.919130 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 04:02:01.919130 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 04:02:01.919130 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application session.commit() Aug 24 04:02:01.919130 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 04:02:01.919130 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 04:02:01.919130 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 04:02:01.920141 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 04:02:01.920141 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 04:02:01.920141 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application self.session.flush() Aug 24 04:02:01.920141 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 04:02:01.920141 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 04:02:01.920141 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 04:02:01.920141 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 04:02:01.920141 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 04:02:01.920141 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application compat.raise_( Aug 24 04:02:01.920141 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 04:02:01.920141 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception Aug 24 04:02:01.920141 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 04:02:01.920141 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 04:02:01.920141 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 04:02:01.920141 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 04:02:01.920141 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 04:02:01.920141 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 04:02:01.921958 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 04:02:01.921958 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 04:02:01.921958 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 24 04:02:01.921958 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 24 04:02:01.921958 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 04:02:01.921958 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 04:02:01.921958 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 04:02:01.921958 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 04:02:01.921958 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 04:02:01.921958 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 04:02:01.921958 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 04:02:01.921958 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 04:02:01.921958 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 04:02:01.921958 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 04:02:01.921958 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 04:02:01.921958 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception Aug 24 04:02:01.923150 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 04:02:01.923150 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 04:02:01.923150 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 04:02:01.923150 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 04:02:01.923150 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 04:02:01.923150 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 04:02:01.923150 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 04:02:01.923150 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application conn.query(q) Aug 24 04:02:01.923150 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 04:02:01.923150 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 04:02:01.923150 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 04:02:01.923150 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application result.read() Aug 24 04:02:01.923150 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 04:02:01.923150 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 04:02:01.923150 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 04:02:01.923150 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 04:02:01.924868 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 04:02:01.924868 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 04:02:01.924868 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 04:02:01.924868 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 04:02:01.924868 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 04:02:01.924868 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 04:02:01.924868 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [parameters: {'user_id': 'd08241e436b943d9ae56dad29b66093f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 04:02:01.924868 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 04:02:01.924868 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:02:01.924868 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:02:01.924868 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:02:01.924868 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:02:01.924868 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:02:01.924868 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:02:01.924868 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:02:01.926032 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:02:01.926032 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:02:01.926032 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:02:01.926032 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:02:01.926032 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:02:01.926032 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:02:01.926032 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:02:01.926032 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 24 04:02:01.926032 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 24 04:02:01.926032 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:02:01.926032 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:02:01.926032 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:02:01.926032 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:02:01.926032 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:02:01.926032 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:02:01.926032 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 24 04:02:01.926032 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 24 04:02:01.927180 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 24 04:02:01.927180 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 24 04:02:01.927180 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 04:02:01.927180 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 04:02:01.927180 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 04:02:01.927180 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:02:01.927180 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 393/806] 10.222.0.15 () {60 vars in 1131 bytes} [Wed Aug 24 04:02:01 2022] POST /identity/v3/users => generated 160 bytes in 175 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:02:01.927765 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae507468-4ce4-4269-b090-3e8d2a204bf7 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:02:02.029802 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae507468-4ce4-4269-b090-3e8d2a204bf7 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:02:02.064637 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf798c2-8577-4182-a6cc-08d126fccb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:02:02.065252 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf798c2-8577-4182-a6cc-08d126fccb58 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:02:02.065531 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf798c2-8577-4182-a6cc-08d126fccb58 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:02:02.065804 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf798c2-8577-4182-a6cc-08d126fccb58 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:02:02.073863 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf798c2-8577-4182-a6cc-08d126fccb58 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:02:02.075342 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf798c2-8577-4182-a6cc-08d126fccb58 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:02:02.086479 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-eaf798c2-8577-4182-a6cc-08d126fccb58 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 04:02:02.086479 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:02:02.086479 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:02:02.086479 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:02:02.086479 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:02:02.086479 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:02:02.086479 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:02:02.086479 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:02:02.086479 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:02:02.086479 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:02:02.086479 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:02:02.086479 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:02:02.086479 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:02:02.086479 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:02:02.086479 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:02:02.086479 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:02:02.087508 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:02:02.087508 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:02:02.087508 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:02:02.087508 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:02:02.087508 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:02:02.087508 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:02:02.087508 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:02:02.087508 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:02:02.087508 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:02:02.087508 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:02:02.087508 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:02:02.087508 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:02:02.087508 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:02:02.087508 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:02:02.087508 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:02:02.087508 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:02:02.087508 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:02:02.087508 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:02:02.088532 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:02:02.088532 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:02:02.088532 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:02:02.088532 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:02:02.088532 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:02:02.088532 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:02:02.088532 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:02:02.088532 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:02:02.088532 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 04:02:02.088532 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:02:02.088532 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 414/807] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 04:02:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:02:02.094689 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec0c8d-380e-4c46-b254-2fe5c23dd055 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:02:02.190772 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:02:02.224473 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec0c8d-380e-4c46-b254-2fe5c23dd055 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:02:02.258197 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de943c1c-6373-49ed-8e6b-8b5d36c3b76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:02:02.258803 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de943c1c-6373-49ed-8e6b-8b5d36c3b76d None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:02:02.259075 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de943c1c-6373-49ed-8e6b-8b5d36c3b76d None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:02:02.259378 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de943c1c-6373-49ed-8e6b-8b5d36c3b76d None admin] PATH_INFO: `/v3/users` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:02:02.260071 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de943c1c-6373-49ed-8e6b-8b5d36c3b76d None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:02:02.260370 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de943c1c-6373-49ed-8e6b-8b5d36c3b76d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:02:02.262007 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de943c1c-6373-49ed-8e6b-8b5d36c3b76d None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:02:02.302398 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 394/808] 10.222.0.15 () {56 vars in 1101 bytes} [Wed Aug 24 04:02:02 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:02:03.643585 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39edd4-ac03-46b7-b3e9-835a49e753da None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:02:03.644173 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39edd4-ac03-46b7-b3e9-835a49e753da None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:02:03.644173 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39edd4-ac03-46b7-b3e9-835a49e753da None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:02:03.645489 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 415/809] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:02:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:02:03.652778 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ad616-8a91-4857-a401-a7da8f5b4ff4 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:02:03.653228 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ad616-8a91-4857-a401-a7da8f5b4ff4 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:02:03.653431 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ad616-8a91-4857-a401-a7da8f5b4ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:02:03.803972 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-c62ad616-8a91-4857-a401-a7da8f5b4ff4 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:02:03.805514 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-c62ad616-8a91-4857-a401-a7da8f5b4ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:02:03.887592 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 395/810] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:02:03 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:02:04.205229 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab39edd4-ac03-46b7-b3e9-835a49e753da None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:02:04.218829 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:02:04.318868 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab39edd4-ac03-46b7-b3e9-835a49e753da None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:02:04.356861 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d75b034-5921-48e3-ace8-6d4479ab9d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:02:04.357486 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75b034-5921-48e3-ace8-6d4479ab9d8c None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:02:04.357761 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75b034-5921-48e3-ace8-6d4479ab9d8c None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:02:04.358028 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75b034-5921-48e3-ace8-6d4479ab9d8c None admin] PATH_INFO: `/v3/services/compute` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:02:04.358607 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d75b034-5921-48e3-ace8-6d4479ab9d8c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:02:04.359994 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d75b034-5921-48e3-ace8-6d4479ab9d8c None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:02:04.369574 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-9d75b034-5921-48e3-ace8-6d4479ab9d8c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 04:02:04.369574 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:02:04.369574 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:02:04.369574 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:02:04.369574 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:02:04.369574 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:02:04.369574 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:02:04.369574 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:02:04.369574 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 04:02:04.369574 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:02:04.369574 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:02:04.369574 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:02:04.369574 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:02:04.369574 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:02:04.369574 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:02:04.369574 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:02:04.369574 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:02:04.370713 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:02:04.370713 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:02:04.370713 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:02:04.370713 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:02:04.370713 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:02:04.370713 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:02:04.370713 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:02:04.370713 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:02:04.370713 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:02:04.370713 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:02:04.370713 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:02:04.370713 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:02:04.370713 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:02:04.370713 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:02:04.370713 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:02:04.370713 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:02:04.372147 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:02:04.372147 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:02:04.372147 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:02:04.372147 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:02:04.372147 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:02:04.372147 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:02:04.372147 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:02:04.372147 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:02:04.372147 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:02:04.372147 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:02:04.372147 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:02:04.372147 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:02:04.372147 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 04:02:04.372147 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:02:04.372147 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 416/811] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 24 04:02:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:02:04.380415 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ad616-8a91-4857-a401-a7da8f5b4ff4 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:02:04.455087 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:02:04.497333 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ad616-8a91-4857-a401-a7da8f5b4ff4 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:02:04.533526 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa77c62-0ded-49ca-bed9-4e207ea88f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:02:04.534127 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa77c62-0ded-49ca-bed9-4e207ea88f87 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:02:04.534382 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa77c62-0ded-49ca-bed9-4e207ea88f87 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:02:04.534661 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa77c62-0ded-49ca-bed9-4e207ea88f87 None admin] PATH_INFO: `/v3/services` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:02:04.535301 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa77c62-0ded-49ca-bed9-4e207ea88f87 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:02:04.535614 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa77c62-0ded-49ca-bed9-4e207ea88f87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:02:04.537211 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa77c62-0ded-49ca-bed9-4e207ea88f87 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:02:04.542232 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 396/812] 10.222.0.15 () {56 vars in 1112 bytes} [Wed Aug 24 04:02:04 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:02:04.548305 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d75b034-5921-48e3-ace8-6d4479ab9d8c None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:02:04.625521 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:02:04.655795 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d75b034-5921-48e3-ace8-6d4479ab9d8c None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:02:04.692315 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a44102-b87d-47dc-b0a2-28c11e62e3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:02:04.692936 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a44102-b87d-47dc-b0a2-28c11e62e3ab None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:02:04.693505 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a44102-b87d-47dc-b0a2-28c11e62e3ab None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:02:04.693801 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a44102-b87d-47dc-b0a2-28c11e62e3ab None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:02:04.694419 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a44102-b87d-47dc-b0a2-28c11e62e3ab None admin] RBAC: Adding query filter params (type=compute) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:02:04.694715 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a44102-b87d-47dc-b0a2-28c11e62e3ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:02:04.696103 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a44102-b87d-47dc-b0a2-28c11e62e3ab None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:02:04.701175 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 417/813] 10.222.0.15 () {56 vars in 1112 bytes} [Wed Aug 24 04:02:04 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:02:04.709837 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa77c62-0ded-49ca-bed9-4e207ea88f87 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:02:04.813315 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa77c62-0ded-49ca-bed9-4e207ea88f87 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:02:04.844654 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:02:04.855252 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98dd56d-b59f-4dbc-9cd0-b8cd4620aa15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:02:04.855860 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98dd56d-b59f-4dbc-9cd0-b8cd4620aa15 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:02:04.856133 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98dd56d-b59f-4dbc-9cd0-b8cd4620aa15 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:02:04.856404 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98dd56d-b59f-4dbc-9cd0-b8cd4620aa15 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:02:04.857091 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98dd56d-b59f-4dbc-9cd0-b8cd4620aa15 None admin] RBAC: Adding query filter params (interface=public, service_id=663c69c63015412baf2208150e8924cf, region_id=RegionOne) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:02:04.857387 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98dd56d-b59f-4dbc-9cd0-b8cd4620aa15 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:02:04.858750 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98dd56d-b59f-4dbc-9cd0-b8cd4620aa15 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:02:04.864293 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 397/814] 10.222.0.15 () {56 vars in 1251 bytes} [Wed Aug 24 04:02:04 2022] GET /identity/v3/endpoints?service_id=663c69c63015412baf2208150e8924cf&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:02:04.870187 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a44102-b87d-47dc-b0a2-28c11e62e3ab None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:02:04.975118 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a44102-b87d-47dc-b0a2-28c11e62e3ab None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:02:05.010365 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4159098-8fd6-4220-b6f6-75ae1225273b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:02:05.010958 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4159098-8fd6-4220-b6f6-75ae1225273b None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:02:05.011353 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4159098-8fd6-4220-b6f6-75ae1225273b None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:02:05.011680 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4159098-8fd6-4220-b6f6-75ae1225273b None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:02:05.012440 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4159098-8fd6-4220-b6f6-75ae1225273b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:02:05.013824 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4159098-8fd6-4220-b6f6-75ae1225273b None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:02:05.020354 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 418/815] 10.222.0.15 () {56 vars in 1087 bytes} [Wed Aug 24 04:02:04 2022] GET /identity/v3/services => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:02:07.174138 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e249e-d2d3-447f-9936-3d5e160784ef None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:02:07.174688 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e249e-d2d3-447f-9936-3d5e160784ef None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:02:07.174688 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e249e-d2d3-447f-9936-3d5e160784ef None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:02:07.175946 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 398/816] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:02:07.181572 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7cc12-e649-4813-adea-7eafa99b6250 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:02:07.182049 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7cc12-e649-4813-adea-7eafa99b6250 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:02:07.182142 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7cc12-e649-4813-adea-7eafa99b6250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:02:07.188818 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:02:07.203060 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-27f7cc12-e649-4813-adea-7eafa99b6250 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:02:07.204302 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-27f7cc12-e649-4813-adea-7eafa99b6250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:02:07.276689 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 419/817] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:02:07 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:02:07.596926 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e249e-d2d3-447f-9936-3d5e160784ef None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:02:07.718280 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e249e-d2d3-447f-9936-3d5e160784ef None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:02:07.754981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54709e-fc45-455e-bdac-f50cb5b0ba96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:02:07.755723 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54709e-fc45-455e-bdac-f50cb5b0ba96 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:02:07.756038 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54709e-fc45-455e-bdac-f50cb5b0ba96 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:02:07.756349 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54709e-fc45-455e-bdac-f50cb5b0ba96 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:02:07.756976 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da54709e-fc45-455e-bdac-f50cb5b0ba96 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:02:07.758394 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da54709e-fc45-455e-bdac-f50cb5b0ba96 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:02:07.767688 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-da54709e-fc45-455e-bdac-f50cb5b0ba96 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 04:02:07.767688 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:02:07.767688 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:02:07.767688 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:02:07.767688 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:02:07.767688 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:02:07.767688 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:02:07.767688 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:02:07.767688 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 04:02:07.767688 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:02:07.767688 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:02:07.767688 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:02:07.767688 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:02:07.767688 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:02:07.767688 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:02:07.767688 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:02:07.767688 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:02:07.768928 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:02:07.768928 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:02:07.768928 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:02:07.768928 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:02:07.768928 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:02:07.768928 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:02:07.768928 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:02:07.768928 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:02:07.768928 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:02:07.768928 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:02:07.768928 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:02:07.768928 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:02:07.768928 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:02:07.768928 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:02:07.768928 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:02:07.768928 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:02:07.770086 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:02:07.770086 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:02:07.770086 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:02:07.770086 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:02:07.770086 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:02:07.770086 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:02:07.770086 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:02:07.770086 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:02:07.770086 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:02:07.770086 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:02:07.770086 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:02:07.770086 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:02:07.770086 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 04:02:07.770086 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:02:07.771370 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 399/818] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 24 04:02:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:02:07.774967 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7cc12-e649-4813-adea-7eafa99b6250 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:02:07.880088 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7cc12-e649-4813-adea-7eafa99b6250 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:02:07.910945 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:02:07.916887 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80144ce-06d4-45b3-8e54-a1826926152a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:02:07.917497 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80144ce-06d4-45b3-8e54-a1826926152a None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:02:07.917775 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80144ce-06d4-45b3-8e54-a1826926152a None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:02:07.918048 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80144ce-06d4-45b3-8e54-a1826926152a None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:02:07.918679 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80144ce-06d4-45b3-8e54-a1826926152a None admin] RBAC: Adding query filter params (name=compute) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:02:07.918981 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80144ce-06d4-45b3-8e54-a1826926152a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:02:07.920430 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80144ce-06d4-45b3-8e54-a1826926152a None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:02:07.925677 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 420/819] 10.222.0.15 () {56 vars in 1112 bytes} [Wed Aug 24 04:02:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:02:07.931713 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54709e-fc45-455e-bdac-f50cb5b0ba96 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:02:08.000362 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:02:08.052457 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54709e-fc45-455e-bdac-f50cb5b0ba96 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:02:08.091436 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c057f92-8f78-4cc4-becf-7cce8056902b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:02:08.092067 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c057f92-8f78-4cc4-becf-7cce8056902b None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:02:08.092318 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c057f92-8f78-4cc4-becf-7cce8056902b None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:02:08.092587 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c057f92-8f78-4cc4-becf-7cce8056902b None admin] PATH_INFO: `/v3/services` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:02:08.093232 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c057f92-8f78-4cc4-becf-7cce8056902b None admin] RBAC: Adding query filter params (type=compute) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:02:08.093564 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c057f92-8f78-4cc4-becf-7cce8056902b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:02:08.094948 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c057f92-8f78-4cc4-becf-7cce8056902b None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:02:08.101069 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 400/820] 10.222.0.15 () {56 vars in 1112 bytes} [Wed Aug 24 04:02:07 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:02:08.107379 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80144ce-06d4-45b3-8e54-a1826926152a None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:02:08.226769 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80144ce-06d4-45b3-8e54-a1826926152a None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:02:08.263692 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8889eea6-ce74-4275-bec7-72c06952bd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:02:08.264301 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889eea6-ce74-4275-bec7-72c06952bd44 None admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:02:08.264579 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889eea6-ce74-4275-bec7-72c06952bd44 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:02:08.264849 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889eea6-ce74-4275-bec7-72c06952bd44 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:02:08.265538 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8889eea6-ce74-4275-bec7-72c06952bd44 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:02:08.266925 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8889eea6-ce74-4275-bec7-72c06952bd44 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:02:08.287556 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 421/821] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 24 04:02:08 2022] POST /identity/v3/endpoints => generated 334 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:02:18.097803 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=41 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:02:18.283368 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=73,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:13.736800 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadea4f9-9cc1-417c-9db4-935a88bdf979 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:13.737711 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadea4f9-9cc1-417c-9db4-935a88bdf979 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:13.737711 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadea4f9-9cc1-417c-9db4-935a88bdf979 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:13.738697 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 401/822] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:03:13.744569 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ccd10-cfaf-4a32-abf5-3bb0afc7344c None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:13.745123 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ccd10-cfaf-4a32-abf5-3bb0afc7344c None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:13.745123 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ccd10-cfaf-4a32-abf5-3bb0afc7344c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:13.771327 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-957ccd10-cfaf-4a32-abf5-3bb0afc7344c None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:03:13.773475 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-957ccd10-cfaf-4a32-abf5-3bb0afc7344c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:03:13.875877 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 422/823] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:03:13 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:03:14.229476 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadea4f9-9cc1-417c-9db4-935a88bdf979 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:14.364783 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadea4f9-9cc1-417c-9db4-935a88bdf979 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:14.438385 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1ef65-4408-455f-a0cb-844449fa213c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:14.439545 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1ef65-4408-455f-a0cb-844449fa213c None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:14.439910 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1ef65-4408-455f-a0cb-844449fa213c None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:14.440244 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1ef65-4408-455f-a0cb-844449fa213c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:14.454273 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e1ef65-4408-455f-a0cb-844449fa213c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:14.456271 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e1ef65-4408-455f-a0cb-844449fa213c None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:14.473192 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-65e1ef65-4408-455f-a0cb-844449fa213c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:03:14.473192 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:03:14.473192 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:03:14.473192 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:03:14.473192 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:03:14.473192 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:03:14.473192 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:03:14.473192 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:03:14.473192 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:03:14.473192 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:03:14.473192 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:03:14.473192 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:03:14.473192 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:03:14.473192 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:03:14.473192 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:03:14.473192 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:03:14.474485 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:03:14.474485 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:03:14.474485 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:03:14.474485 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:03:14.474485 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:03:14.474485 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:03:14.474485 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:03:14.474485 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:03:14.474485 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:03:14.474485 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:03:14.474485 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:03:14.474485 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:03:14.474485 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:03:14.474485 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:03:14.474485 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:03:14.474485 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:03:14.474485 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:03:14.475619 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:03:14.475619 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:03:14.475619 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:03:14.475619 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 402/824] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:03:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:03:14.486345 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ccd10-cfaf-4a32-abf5-3bb0afc7344c None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:14.623093 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ccd10-cfaf-4a32-abf5-3bb0afc7344c None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:14.661535 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:14.685692 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93ab30-d309-4354-8e09-fbaae16f8054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:14.686326 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93ab30-d309-4354-8e09-fbaae16f8054 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:14.686601 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93ab30-d309-4354-8e09-fbaae16f8054 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:14.686870 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93ab30-d309-4354-8e09-fbaae16f8054 None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:14.687567 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d93ab30-d309-4354-8e09-fbaae16f8054 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:03:14.687868 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d93ab30-d309-4354-8e09-fbaae16f8054 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:14.689608 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d93ab30-d309-4354-8e09-fbaae16f8054 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:14.705614 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 423/825] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 04:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:03:14.712838 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1ef65-4408-455f-a0cb-844449fa213c None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:14.795368 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:14.866890 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1ef65-4408-455f-a0cb-844449fa213c None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:14.916210 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c1a8d-2410-4e1e-9ada-62cd911d5281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:14.917525 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c1a8d-2410-4e1e-9ada-62cd911d5281 None admin] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:14.917852 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c1a8d-2410-4e1e-9ada-62cd911d5281 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:14.918310 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c1a8d-2410-4e1e-9ada-62cd911d5281 None admin] PATH_INFO: `/v3/users` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:14.919366 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9c1a8d-2410-4e1e-9ada-62cd911d5281 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:14.921658 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9c1a8d-2410-4e1e-9ada-62cd911d5281 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:14.956846 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 403/826] 10.222.0.15 () {60 vars in 1132 bytes} [Wed Aug 24 04:03:14 2022] POST /identity/v3/users => generated 251 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:03:17.525023 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5769ff-3b18-492a-864b-424a91b859ef None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:17.525695 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5769ff-3b18-492a-864b-424a91b859ef None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:17.525910 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5769ff-3b18-492a-864b-424a91b859ef None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:17.528289 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 424/827] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:03:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:03:17.536447 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3324826-296b-4d66-8dc6-02aaf28dcfdf None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:17.537338 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3324826-296b-4d66-8dc6-02aaf28dcfdf None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:17.537338 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3324826-296b-4d66-8dc6-02aaf28dcfdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:17.563700 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-b3324826-296b-4d66-8dc6-02aaf28dcfdf None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:03:17.565773 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-b3324826-296b-4d66-8dc6-02aaf28dcfdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:03:17.655101 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 404/828] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:03:17 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:03:18.028968 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5769ff-3b18-492a-864b-424a91b859ef None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:18.182941 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5769ff-3b18-492a-864b-424a91b859ef None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:18.237473 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819968e1-231e-4562-a4bb-159dfc440982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:18.238159 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819968e1-231e-4562-a4bb-159dfc440982 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:18.238477 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819968e1-231e-4562-a4bb-159dfc440982 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:18.238878 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819968e1-231e-4562-a4bb-159dfc440982 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:18.254701 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819968e1-231e-4562-a4bb-159dfc440982 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:03:18.263128 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-819968e1-231e-4562-a4bb-159dfc440982 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:03:18.263128 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:03:18.263128 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:03:18.263128 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:03:18.263128 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:03:18.263128 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:03:18.263128 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:03:18.263128 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:03:18.263128 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:03:18.263128 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:03:18.263128 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:03:18.263128 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:03:18.263128 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:03:18.263128 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:03:18.263128 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:03:18.263128 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:03:18.265245 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:03:18.265245 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:03:18.265245 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:03:18.265245 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:03:18.265245 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:03:18.265245 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:03:18.265245 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:03:18.265245 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:03:18.265245 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:03:18.265245 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:03:18.265245 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:03:18.265245 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:03:18.265245 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:03:18.265245 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:03:18.265245 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:03:18.265245 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:03:18.267514 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:03:18.267514 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:03:18.267514 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:03:18.267514 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:03:18.267514 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:03:18.267514 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:03:18.267514 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:03:18.267514 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:03:18.267514 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:03:18.267514 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:03:18.267514 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:03:18.267514 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:03:18.267514 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 425/829] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Aug 24 04:03:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:03:18.272547 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3324826-296b-4d66-8dc6-02aaf28dcfdf None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:18.340529 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:18.430735 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3324826-296b-4d66-8dc6-02aaf28dcfdf None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:18.481336 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b31c2-f7b5-4862-8fb4-f087acb26389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:18.482143 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b31c2-f7b5-4862-8fb4-f087acb26389 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:18.482631 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b31c2-f7b5-4862-8fb4-f087acb26389 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:18.483172 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b31c2-f7b5-4862-8fb4-f087acb26389 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:18.487705 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b31c2-f7b5-4862-8fb4-f087acb26389 None admin] RBAC: Adding query filter params (name=service) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:03:18.488000 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b31c2-f7b5-4862-8fb4-f087acb26389 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:18.489568 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b31c2-f7b5-4862-8fb4-f087acb26389 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:18.503511 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 405/830] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Aug 24 04:03:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:03:18.509917 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819968e1-231e-4562-a4bb-159dfc440982 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:18.585880 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:18.680266 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819968e1-231e-4562-a4bb-159dfc440982 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:18.732965 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dba182-135c-4252-81ec-39246ebb344c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:18.733547 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dba182-135c-4252-81ec-39246ebb344c None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:18.733808 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dba182-135c-4252-81ec-39246ebb344c None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:18.734066 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dba182-135c-4252-81ec-39246ebb344c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:18.746370 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dba182-135c-4252-81ec-39246ebb344c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:18.749209 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dba182-135c-4252-81ec-39246ebb344c None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:18.777898 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-08dba182-135c-4252-81ec-39246ebb344c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:03:18.777898 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:03:18.777898 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:03:18.777898 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:03:18.777898 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:03:18.777898 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:03:18.777898 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:03:18.777898 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:03:18.777898 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:03:18.777898 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:03:18.777898 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:03:18.777898 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:03:18.777898 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:03:18.777898 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:03:18.777898 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:03:18.777898 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:03:18.779158 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:03:18.779158 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:03:18.779158 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:03:18.779158 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:03:18.779158 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:03:18.779158 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:03:18.779158 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:03:18.779158 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:03:18.779158 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:03:18.779158 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:03:18.779158 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:03:18.779158 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:03:18.779158 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:03:18.779158 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:03:18.779158 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:03:18.779158 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:03:18.779158 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:03:18.780199 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:03:18.780199 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:03:18.780199 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:03:18.780199 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 426/831] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:03:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:03:18.790442 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b31c2-f7b5-4862-8fb4-f087acb26389 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:18.976224 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:18.981292 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b31c2-f7b5-4862-8fb4-f087acb26389 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:19.036120 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c8b44-2c4d-4874-ae98-3c284bafc8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:19.036887 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c8b44-2c4d-4874-ae98-3c284bafc8b8 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:19.037282 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c8b44-2c4d-4874-ae98-3c284bafc8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:19.037664 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c8b44-2c4d-4874-ae98-3c284bafc8b8 None admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:19.038494 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5c8b44-2c4d-4874-ae98-3c284bafc8b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:03:19.038878 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5c8b44-2c4d-4874-ae98-3c284bafc8b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:19.040597 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5c8b44-2c4d-4874-ae98-3c284bafc8b8 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:19.059862 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 406/832] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 04:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:03:19.067681 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dba182-135c-4252-81ec-39246ebb344c None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:19.211638 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:19.221359 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dba182-135c-4252-81ec-39246ebb344c None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:19.266420 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44239568-1298-4441-8b48-1d8355e7eb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:19.266420 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44239568-1298-4441-8b48-1d8355e7eb41 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:19.266420 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44239568-1298-4441-8b48-1d8355e7eb41 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:19.266420 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44239568-1298-4441-8b48-1d8355e7eb41 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:19.278292 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44239568-1298-4441-8b48-1d8355e7eb41 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:19.280250 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44239568-1298-4441-8b48-1d8355e7eb41 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:19.295970 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-44239568-1298-4441-8b48-1d8355e7eb41 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:03:19.295970 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:03:19.295970 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:03:19.295970 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:03:19.295970 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:03:19.295970 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:03:19.295970 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:03:19.295970 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:03:19.295970 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:03:19.295970 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:03:19.295970 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:03:19.295970 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:03:19.295970 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:03:19.295970 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:03:19.295970 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:03:19.295970 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:03:19.298228 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:03:19.298228 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:03:19.298228 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:03:19.298228 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:03:19.298228 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:03:19.298228 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:03:19.298228 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:03:19.298228 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:03:19.298228 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:03:19.298228 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:03:19.298228 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:03:19.298228 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:03:19.298228 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:03:19.298228 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:03:19.298228 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:03:19.298228 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:03:19.298228 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:03:19.298228 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:03:19.300942 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:03:19.300942 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:03:19.300942 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:03:19.300942 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:03:19.300942 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:03:19.300942 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:03:19.300942 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:03:19.300942 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:03:19.300942 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:03:19.300942 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:03:19.300942 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 427/833] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:03:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:03:19.304097 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c8b44-2c4d-4874-ae98-3c284bafc8b8 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:19.442850 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c8b44-2c4d-4874-ae98-3c284bafc8b8 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:19.485313 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8997cb6-88c5-48a9-a58c-4174e483254f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:19.486256 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8997cb6-88c5-48a9-a58c-4174e483254f None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:19.486560 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8997cb6-88c5-48a9-a58c-4174e483254f None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:19.486829 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8997cb6-88c5-48a9-a58c-4174e483254f None admin] PATH_INFO: `/v3/users` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:19.487697 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8997cb6-88c5-48a9-a58c-4174e483254f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:03:19.487997 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8997cb6-88c5-48a9-a58c-4174e483254f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:19.489619 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8997cb6-88c5-48a9-a58c-4174e483254f None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:19.513521 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 407/834] 10.222.0.15 () {56 vars in 1143 bytes} [Wed Aug 24 04:03:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:03:19.520488 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44239568-1298-4441-8b48-1d8355e7eb41 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:19.683730 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44239568-1298-4441-8b48-1d8355e7eb41 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:19.729815 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aebe04-145c-47d9-b001-b5a4629531b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:19.730675 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aebe04-145c-47d9-b001-b5a4629531b6 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:19.731161 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aebe04-145c-47d9-b001-b5a4629531b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:19.731760 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aebe04-145c-47d9-b001-b5a4629531b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:19.781257 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:19.852108 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aebe04-145c-47d9-b001-b5a4629531b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:19.853584 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aebe04-145c-47d9-b001-b5a4629531b6 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:20.028573 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 428/835] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 24 04:03:19 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:03:20.034897 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8997cb6-88c5-48a9-a58c-4174e483254f None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:20.060007 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:20.181165 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8997cb6-88c5-48a9-a58c-4174e483254f None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:20.230521 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888f031-da56-4101-b354-b59c60a2adcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:20.231508 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888f031-da56-4101-b354-b59c60a2adcd None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:20.231932 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888f031-da56-4101-b354-b59c60a2adcd None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:20.232321 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888f031-da56-4101-b354-b59c60a2adcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:20.249423 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9888f031-da56-4101-b354-b59c60a2adcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:20.252301 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9888f031-da56-4101-b354-b59c60a2adcd None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:20.276707 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-9888f031-da56-4101-b354-b59c60a2adcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:03:20.276707 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:03:20.276707 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:03:20.276707 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:03:20.276707 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:03:20.276707 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:03:20.276707 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:03:20.276707 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:03:20.276707 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:03:20.276707 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:03:20.276707 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:03:20.276707 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:03:20.276707 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:03:20.276707 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:03:20.276707 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:03:20.276707 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:03:20.279082 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:03:20.279082 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:03:20.279082 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:03:20.279082 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:03:20.279082 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:03:20.279082 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:03:20.279082 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:03:20.279082 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:03:20.279082 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:03:20.279082 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:03:20.279082 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:03:20.279082 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:03:20.279082 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:03:20.279082 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:03:20.279082 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:03:20.279082 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:03:20.279082 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:03:20.283385 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:03:20.283385 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:03:20.283385 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:03:20.283385 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 408/836] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:03:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:03:20.288175 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aebe04-145c-47d9-b001-b5a4629531b6 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:20.380121 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:20.454665 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aebe04-145c-47d9-b001-b5a4629531b6 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:20.510087 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2025b988-32f1-481a-96ac-75f49e668c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:20.510846 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025b988-32f1-481a-96ac-75f49e668c35 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:20.511244 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025b988-32f1-481a-96ac-75f49e668c35 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:20.511619 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025b988-32f1-481a-96ac-75f49e668c35 None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:20.512503 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2025b988-32f1-481a-96ac-75f49e668c35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:03:20.512848 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2025b988-32f1-481a-96ac-75f49e668c35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:20.514755 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2025b988-32f1-481a-96ac-75f49e668c35 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:20.543729 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 429/837] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 04:03:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:03:20.545983 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888f031-da56-4101-b354-b59c60a2adcd None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:20.665019 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:20.708934 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888f031-da56-4101-b354-b59c60a2adcd None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:20.747486 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e4878-1bb8-4f6a-a6d8-5491631f522f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:20.748130 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e4878-1bb8-4f6a-a6d8-5491631f522f None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:20.748409 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e4878-1bb8-4f6a-a6d8-5491631f522f None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:20.748679 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261e4878-1bb8-4f6a-a6d8-5491631f522f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:20.756270 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261e4878-1bb8-4f6a-a6d8-5491631f522f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:20.757752 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261e4878-1bb8-4f6a-a6d8-5491631f522f None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:20.769754 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-261e4878-1bb8-4f6a-a6d8-5491631f522f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:03:20.769754 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:03:20.769754 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:03:20.769754 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:03:20.769754 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:03:20.769754 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:03:20.769754 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:03:20.769754 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:03:20.769754 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:03:20.769754 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:03:20.769754 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:03:20.769754 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:03:20.769754 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:03:20.769754 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:03:20.769754 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:03:20.771334 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:03:20.771334 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:03:20.771334 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:03:20.771334 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:03:20.771334 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:03:20.771334 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:03:20.771334 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:03:20.771334 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:03:20.771334 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:03:20.771334 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:03:20.771334 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:03:20.771334 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:03:20.771334 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:03:20.771334 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:03:20.771334 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:03:20.771334 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:03:20.771334 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:03:20.772404 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:03:20.772404 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:03:20.772404 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:03:20.772404 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:03:20.772404 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:03:20.772404 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:03:20.772404 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:03:20.772404 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:03:20.772404 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 409/838] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 24 04:03:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:03:20.778295 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2025b988-32f1-481a-96ac-75f49e668c35 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:20.910149 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2025b988-32f1-481a-96ac-75f49e668c35 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:20.934541 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:20.960687 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bbae7a-46a7-44e9-a808-735b28c5d7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:20.961425 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbae7a-46a7-44e9-a808-735b28c5d7d4 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:20.961867 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbae7a-46a7-44e9-a808-735b28c5d7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:20.962092 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbae7a-46a7-44e9-a808-735b28c5d7d4 None admin] PATH_INFO: `/v3/projects` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:20.962868 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bbae7a-46a7-44e9-a808-735b28c5d7d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:03:20.963172 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bbae7a-46a7-44e9-a808-735b28c5d7d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:20.965222 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bbae7a-46a7-44e9-a808-735b28c5d7d4 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:20.991120 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 430/839] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 24 04:03:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:03:20.993376 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e4878-1bb8-4f6a-a6d8-5491631f522f None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:21.136998 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261e4878-1bb8-4f6a-a6d8-5491631f522f None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:21.182162 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:21.189118 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251824fd-4174-420a-a199-67f9cbf2a482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:21.189908 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251824fd-4174-420a-a199-67f9cbf2a482 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:21.190289 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251824fd-4174-420a-a199-67f9cbf2a482 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:21.190648 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251824fd-4174-420a-a199-67f9cbf2a482 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:21.191607 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251824fd-4174-420a-a199-67f9cbf2a482 None admin] RBAC: Adding query filter params (role.id=4278d3d9834d462b821b63a99db9229a, scope.project.id=5c317b3ce1d1468f95bc01ba2587e623, user.id=a3f34384ad354405a69b3cfa242e9504) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:03:21.192312 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251824fd-4174-420a-a199-67f9cbf2a482 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:21.193868 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251824fd-4174-420a-a199-67f9cbf2a482 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:21.200256 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 410/840] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 24 04:03:20 2022] GET /identity/v3/role_assignments?user.id=a3f34384ad354405a69b3cfa242e9504&scope.project.id=5c317b3ce1d1468f95bc01ba2587e623&role.id=4278d3d9834d462b821b63a99db9229a => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:03:23.648374 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759a631-dee7-43c1-a7c8-c44ba3542f0d None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:23.649199 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759a631-dee7-43c1-a7c8-c44ba3542f0d None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:23.649199 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759a631-dee7-43c1-a7c8-c44ba3542f0d None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:23.650471 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 431/841] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:03:23.656059 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39b7e0-636f-428b-bb36-26faf18ede73 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:23.656836 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39b7e0-636f-428b-bb36-26faf18ede73 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:23.656836 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39b7e0-636f-428b-bb36-26faf18ede73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:23.678026 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-df39b7e0-636f-428b-bb36-26faf18ede73 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:03:23.678835 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-df39b7e0-636f-428b-bb36-26faf18ede73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:03:23.764978 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 411/842] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:03:23 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:03:24.097672 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759a631-dee7-43c1-a7c8-c44ba3542f0d None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:24.250116 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759a631-dee7-43c1-a7c8-c44ba3542f0d None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:24.308924 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e1252-78fd-4f0c-bfdb-ec8b0fd39051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:24.309694 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e1252-78fd-4f0c-bfdb-ec8b0fd39051 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:24.310074 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e1252-78fd-4f0c-bfdb-ec8b0fd39051 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:24.310426 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e1252-78fd-4f0c-bfdb-ec8b0fd39051 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:24.333647 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e1252-78fd-4f0c-bfdb-ec8b0fd39051 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:03:24.341493 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-859e1252-78fd-4f0c-bfdb-ec8b0fd39051 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:03:24.341493 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:03:24.341493 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:03:24.341493 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:03:24.341493 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:03:24.341493 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:03:24.341493 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:03:24.341493 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:03:24.341493 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:03:24.341493 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:03:24.341493 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:03:24.341493 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:03:24.341493 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:03:24.341493 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:03:24.341493 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:03:24.341493 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:03:24.343163 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:03:24.343163 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:03:24.343163 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:03:24.343163 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:03:24.343163 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:03:24.343163 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:03:24.343163 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:03:24.343163 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:03:24.343163 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:03:24.343163 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:03:24.343163 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:03:24.343163 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:03:24.343163 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:03:24.343163 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:03:24.343163 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:03:24.343163 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:03:24.344574 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:03:24.344574 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:03:24.344574 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:03:24.344574 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:03:24.344574 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:03:24.344574 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:03:24.344574 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:03:24.344574 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:03:24.344574 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:03:24.344574 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:03:24.344574 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:03:24.344574 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:03:24.344574 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 432/843] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Aug 24 04:03:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:03:24.353214 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39b7e0-636f-428b-bb36-26faf18ede73 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:24.522185 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39b7e0-636f-428b-bb36-26faf18ede73 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:24.554428 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:24.569273 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d56aa4-8a67-4043-a938-3dab381d7fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:24.570725 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d56aa4-8a67-4043-a938-3dab381d7fcb None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:24.570725 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d56aa4-8a67-4043-a938-3dab381d7fcb None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:24.570725 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d56aa4-8a67-4043-a938-3dab381d7fcb None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:24.571353 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d56aa4-8a67-4043-a938-3dab381d7fcb None admin] RBAC: Adding query filter params (name=service) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:03:24.571658 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d56aa4-8a67-4043-a938-3dab381d7fcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:24.573060 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d56aa4-8a67-4043-a938-3dab381d7fcb None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:24.584285 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 412/844] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Aug 24 04:03:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:03:24.593878 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e1252-78fd-4f0c-bfdb-ec8b0fd39051 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:24.665063 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:24.774650 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e1252-78fd-4f0c-bfdb-ec8b0fd39051 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:24.831367 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31539771-aa5a-4794-92bf-4575d6346044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:24.832423 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31539771-aa5a-4794-92bf-4575d6346044 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:24.832849 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31539771-aa5a-4794-92bf-4575d6346044 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:24.833362 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31539771-aa5a-4794-92bf-4575d6346044 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:24.848482 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31539771-aa5a-4794-92bf-4575d6346044 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:24.851003 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31539771-aa5a-4794-92bf-4575d6346044 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:24.878460 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-31539771-aa5a-4794-92bf-4575d6346044 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:03:24.878460 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:03:24.878460 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:03:24.878460 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:03:24.878460 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:03:24.878460 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:03:24.878460 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:03:24.878460 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:03:24.878460 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:03:24.878460 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:03:24.878460 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:03:24.878460 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:03:24.878460 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:03:24.878460 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:03:24.878460 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:03:24.878460 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:03:24.880473 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:03:24.880473 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:03:24.880473 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:03:24.880473 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:03:24.880473 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:03:24.880473 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:03:24.880473 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:03:24.880473 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:03:24.880473 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:03:24.880473 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:03:24.880473 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:03:24.880473 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:03:24.880473 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:03:24.880473 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:03:24.880473 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:03:24.880473 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:03:24.880473 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:03:24.882362 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:03:24.882362 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:03:24.882362 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:03:24.882362 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 433/845] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:03:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:03:24.888188 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d56aa4-8a67-4043-a938-3dab381d7fcb None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:25.052477 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d56aa4-8a67-4043-a938-3dab381d7fcb None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:25.097312 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd9857-e975-4dec-a41a-cd7d3a2aebbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:25.098207 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd9857-e975-4dec-a41a-cd7d3a2aebbf None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:25.098630 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd9857-e975-4dec-a41a-cd7d3a2aebbf None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:25.099040 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd9857-e975-4dec-a41a-cd7d3a2aebbf None admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:25.099940 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd9857-e975-4dec-a41a-cd7d3a2aebbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:03:25.100230 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd9857-e975-4dec-a41a-cd7d3a2aebbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:25.102100 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd9857-e975-4dec-a41a-cd7d3a2aebbf None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:25.117943 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 413/846] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 04:03:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:03:25.126979 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31539771-aa5a-4794-92bf-4575d6346044 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:25.252369 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:25.268715 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31539771-aa5a-4794-92bf-4575d6346044 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:25.310775 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86517105-c961-42f6-8b7e-35dbe3bb13e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:25.311511 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86517105-c961-42f6-8b7e-35dbe3bb13e8 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:25.311834 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86517105-c961-42f6-8b7e-35dbe3bb13e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:25.312192 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86517105-c961-42f6-8b7e-35dbe3bb13e8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:25.323178 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86517105-c961-42f6-8b7e-35dbe3bb13e8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:25.324946 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86517105-c961-42f6-8b7e-35dbe3bb13e8 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:25.337944 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-86517105-c961-42f6-8b7e-35dbe3bb13e8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:03:25.337944 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:03:25.337944 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:03:25.337944 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:03:25.337944 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:03:25.337944 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:03:25.337944 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:03:25.337944 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:03:25.337944 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:03:25.337944 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:03:25.337944 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:03:25.337944 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:03:25.337944 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:03:25.337944 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:03:25.337944 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:03:25.337944 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:03:25.340602 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:03:25.340602 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:03:25.340602 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:03:25.340602 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:03:25.340602 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:03:25.340602 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:03:25.340602 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:03:25.340602 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:03:25.340602 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:03:25.340602 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:03:25.340602 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:03:25.340602 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:03:25.340602 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:03:25.340602 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:03:25.340602 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:03:25.340602 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:03:25.340602 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:03:25.340602 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:03:25.343952 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:03:25.343952 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:03:25.343952 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:03:25.343952 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:03:25.343952 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:03:25.343952 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:03:25.343952 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:03:25.343952 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:03:25.343952 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:03:25.343952 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:03:25.343952 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 434/847] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:03:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:03:25.348023 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd9857-e975-4dec-a41a-cd7d3a2aebbf None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:25.414541 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:25.499223 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd9857-e975-4dec-a41a-cd7d3a2aebbf None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:25.553961 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1925c-adf0-4cb2-a8ae-ece723cdfea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:25.554772 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1925c-adf0-4cb2-a8ae-ece723cdfea0 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:25.555165 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1925c-adf0-4cb2-a8ae-ece723cdfea0 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:25.555554 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1925c-adf0-4cb2-a8ae-ece723cdfea0 None admin] PATH_INFO: `/v3/users` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:25.556434 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1925c-adf0-4cb2-a8ae-ece723cdfea0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:03:25.556858 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1925c-adf0-4cb2-a8ae-ece723cdfea0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:25.558512 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1925c-adf0-4cb2-a8ae-ece723cdfea0 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:25.587835 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 414/848] 10.222.0.15 () {56 vars in 1143 bytes} [Wed Aug 24 04:03:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:03:25.595476 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86517105-c961-42f6-8b7e-35dbe3bb13e8 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:25.744444 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86517105-c961-42f6-8b7e-35dbe3bb13e8 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:25.789574 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c66c097-3ce4-45c3-9752-652622ee4f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:25.790356 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66c097-3ce4-45c3-9752-652622ee4f5b None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:25.790621 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66c097-3ce4-45c3-9752-652622ee4f5b None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:25.790938 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66c097-3ce4-45c3-9752-652622ee4f5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:25.806925 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c66c097-3ce4-45c3-9752-652622ee4f5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:25.809082 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c66c097-3ce4-45c3-9752-652622ee4f5b None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:25.828273 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-8c66c097-3ce4-45c3-9752-652622ee4f5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:03:25.828273 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:03:25.828273 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:03:25.828273 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:03:25.828273 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:03:25.828273 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:03:25.828273 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:03:25.828273 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:03:25.828273 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:03:25.828273 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:03:25.828273 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:03:25.828273 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:03:25.828273 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:03:25.828273 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:03:25.828273 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:03:25.828273 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:03:25.834454 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:03:25.834454 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:03:25.834454 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:03:25.834454 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:03:25.834454 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:03:25.834454 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:03:25.834454 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:03:25.834454 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:03:25.834454 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:03:25.834454 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:03:25.834454 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:03:25.834454 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:03:25.834454 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:03:25.834454 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:03:25.834454 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:03:25.834454 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:03:25.834454 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:03:25.835494 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:03:25.835494 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:03:25.835494 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:03:25.835494 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 435/849] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:03:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:03:25.837096 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1925c-adf0-4cb2-a8ae-ece723cdfea0 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:26.017975 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1925c-adf0-4cb2-a8ae-ece723cdfea0 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:26.021509 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:26.075692 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa16ab-d1a3-4ee6-a1c4-3e04d17f0178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:26.076443 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa16ab-d1a3-4ee6-a1c4-3e04d17f0178 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:26.076782 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa16ab-d1a3-4ee6-a1c4-3e04d17f0178 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:26.077186 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa16ab-d1a3-4ee6-a1c4-3e04d17f0178 None admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:26.078067 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa16ab-d1a3-4ee6-a1c4-3e04d17f0178 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:03:26.078444 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa16ab-d1a3-4ee6-a1c4-3e04d17f0178 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:26.080186 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa16ab-d1a3-4ee6-a1c4-3e04d17f0178 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:26.102735 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 415/850] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 04:03:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:03:26.109185 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c66c097-3ce4-45c3-9752-652622ee4f5b None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:26.112666 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:26.265099 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c66c097-3ce4-45c3-9752-652622ee4f5b None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:26.304709 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655e199-fee2-47c5-85b3-8f5390be0a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:26.305499 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655e199-fee2-47c5-85b3-8f5390be0a22 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:26.305778 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655e199-fee2-47c5-85b3-8f5390be0a22 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:26.306082 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655e199-fee2-47c5-85b3-8f5390be0a22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:26.314642 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4655e199-fee2-47c5-85b3-8f5390be0a22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:26.316290 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4655e199-fee2-47c5-85b3-8f5390be0a22 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:26.329341 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-4655e199-fee2-47c5-85b3-8f5390be0a22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:03:26.329341 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:03:26.329341 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:03:26.329341 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:03:26.329341 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:03:26.329341 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:03:26.329341 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:03:26.329341 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:03:26.329341 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:03:26.329341 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:03:26.329341 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:03:26.329341 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:03:26.329341 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:03:26.329341 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:03:26.329341 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:03:26.330816 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:03:26.330816 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:03:26.330816 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:03:26.330816 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:03:26.330816 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:03:26.330816 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:03:26.330816 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:03:26.330816 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:03:26.330816 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:03:26.330816 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:03:26.330816 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:03:26.330816 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:03:26.330816 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:03:26.330816 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:03:26.330816 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:03:26.330816 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:03:26.330816 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:03:26.331979 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:03:26.331979 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:03:26.331979 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:03:26.331979 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:03:26.331979 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:03:26.331979 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:03:26.331979 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:03:26.331979 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:03:26.331979 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 436/851] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 24 04:03:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:03:26.336981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa16ab-d1a3-4ee6-a1c4-3e04d17f0178 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:26.480452 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa16ab-d1a3-4ee6-a1c4-3e04d17f0178 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:26.540408 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf2415d-fa17-424f-a246-39062ac01610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:26.540916 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2415d-fa17-424f-a246-39062ac01610 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:26.541190 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2415d-fa17-424f-a246-39062ac01610 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:26.541461 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf2415d-fa17-424f-a246-39062ac01610 None admin] PATH_INFO: `/v3/projects` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:26.542227 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf2415d-fa17-424f-a246-39062ac01610 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:03:26.542497 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf2415d-fa17-424f-a246-39062ac01610 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:26.544088 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf2415d-fa17-424f-a246-39062ac01610 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:26.559300 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 416/852] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 24 04:03:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:03:26.567217 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655e199-fee2-47c5-85b3-8f5390be0a22 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:26.651256 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:26.719166 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655e199-fee2-47c5-85b3-8f5390be0a22 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:26.760887 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f44628-b076-40d4-98f5-8402706961e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:26.761749 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f44628-b076-40d4-98f5-8402706961e9 None admin] REQUEST_METHOD: `PUT` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:26.761897 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f44628-b076-40d4-98f5-8402706961e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:26.762151 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f44628-b076-40d4-98f5-8402706961e9 None admin] PATH_INFO: `/v3/projects/5c317b3ce1d1468f95bc01ba2587e623/users/a3f34384ad354405a69b3cfa242e9504/roles/4278d3d9834d462b821b63a99db9229a` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:26.782465 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f44628-b076-40d4-98f5-8402706961e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c317b3ce1d1468f95bc01ba2587e623, user_id=a3f34384ad354405a69b3cfa242e9504, role_id=4278d3d9834d462b821b63a99db9229a)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:26.784139 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f44628-b076-40d4-98f5-8402706961e9 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:26.797779 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 437/853] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Aug 24 04:03:26 2022] PUT /identity/v3/projects/5c317b3ce1d1468f95bc01ba2587e623/users/a3f34384ad354405a69b3cfa242e9504/roles/4278d3d9834d462b821b63a99db9229a => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:03:29.525490 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f82eac-2b61-411f-834e-65f1f0c283a7 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:29.526083 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f82eac-2b61-411f-834e-65f1f0c283a7 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:29.526083 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f82eac-2b61-411f-834e-65f1f0c283a7 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:29.527359 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 417/854] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:03:29.533133 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fca029-7e2f-426f-bb0f-9f9b2dac8426 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:29.533766 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fca029-7e2f-426f-bb0f-9f9b2dac8426 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:29.533766 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fca029-7e2f-426f-bb0f-9f9b2dac8426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:29.554304 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-38fca029-7e2f-426f-bb0f-9f9b2dac8426 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:03:29.555561 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-38fca029-7e2f-426f-bb0f-9f9b2dac8426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:03:29.633511 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 438/855] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:03:29 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:03:29.980162 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f82eac-2b61-411f-834e-65f1f0c283a7 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:30.010340 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:30.099220 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f82eac-2b61-411f-834e-65f1f0c283a7 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:30.135856 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f724d-7401-4e0b-a153-9805954d8265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:30.136648 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f724d-7401-4e0b-a153-9805954d8265 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:30.137070 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f724d-7401-4e0b-a153-9805954d8265 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:30.137464 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f724d-7401-4e0b-a153-9805954d8265 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:30.149952 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f724d-7401-4e0b-a153-9805954d8265 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:03:30.156681 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-ba3f724d-7401-4e0b-a153-9805954d8265 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:03:30.156681 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:03:30.156681 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:03:30.156681 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:03:30.156681 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:03:30.156681 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:03:30.156681 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:03:30.156681 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:03:30.156681 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:03:30.156681 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:03:30.156681 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:03:30.156681 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:03:30.156681 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:03:30.156681 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:03:30.156681 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:03:30.156681 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:03:30.158034 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:03:30.158034 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:03:30.158034 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:03:30.158034 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:03:30.158034 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:03:30.158034 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:03:30.158034 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:03:30.158034 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:03:30.158034 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:03:30.158034 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:03:30.158034 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:03:30.158034 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:03:30.158034 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:03:30.158034 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:03:30.158034 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:03:30.158034 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:03:30.159046 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:03:30.159046 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:03:30.159046 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:03:30.159046 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:03:30.159046 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:03:30.159046 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:03:30.159046 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:03:30.159046 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:03:30.159046 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:03:30.159046 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:03:30.159046 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:03:30.159046 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:03:30.159046 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 418/856] 10.222.0.15 () {56 vars in 1102 bytes} [Wed Aug 24 04:03:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:03:30.165285 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fca029-7e2f-426f-bb0f-9f9b2dac8426 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:30.216668 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:30.281287 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fca029-7e2f-426f-bb0f-9f9b2dac8426 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:30.320006 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397cb4eb-4ab1-4b95-a725-1134dea1faf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:30.320664 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397cb4eb-4ab1-4b95-a725-1134dea1faf9 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:30.320991 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397cb4eb-4ab1-4b95-a725-1134dea1faf9 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:30.321299 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397cb4eb-4ab1-4b95-a725-1134dea1faf9 None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:30.321949 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397cb4eb-4ab1-4b95-a725-1134dea1faf9 None admin] RBAC: Adding query filter params (name=service) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:03:30.322245 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397cb4eb-4ab1-4b95-a725-1134dea1faf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:30.323676 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397cb4eb-4ab1-4b95-a725-1134dea1faf9 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:30.333264 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 439/857] 10.222.0.15 () {56 vars in 1103 bytes} [Wed Aug 24 04:03:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:03:30.339800 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f724d-7401-4e0b-a153-9805954d8265 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:30.449286 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:30.468553 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f724d-7401-4e0b-a153-9805954d8265 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:30.506497 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412f859-a935-43f8-a08c-42b8da0435b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:30.507544 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412f859-a935-43f8-a08c-42b8da0435b6 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:30.507828 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412f859-a935-43f8-a08c-42b8da0435b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:30.508126 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412f859-a935-43f8-a08c-42b8da0435b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:30.521419 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8412f859-a935-43f8-a08c-42b8da0435b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:30.523019 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8412f859-a935-43f8-a08c-42b8da0435b6 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:30.540210 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-8412f859-a935-43f8-a08c-42b8da0435b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:03:30.540210 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:03:30.540210 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:03:30.540210 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:03:30.540210 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:03:30.540210 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:03:30.540210 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:03:30.540210 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:03:30.540210 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:03:30.540210 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:03:30.540210 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:03:30.540210 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:03:30.540210 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:03:30.540210 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:03:30.540210 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:03:30.540210 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:03:30.541888 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:03:30.541888 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:03:30.541888 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:03:30.541888 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:03:30.541888 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:03:30.541888 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:03:30.541888 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:03:30.541888 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:03:30.541888 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:03:30.541888 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:03:30.541888 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:03:30.541888 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:03:30.541888 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:03:30.541888 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:03:30.541888 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:03:30.541888 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:03:30.541888 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:03:30.542857 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:03:30.542857 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:03:30.542857 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:03:30.542857 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 419/858] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:03:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:03:30.547389 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397cb4eb-4ab1-4b95-a725-1134dea1faf9 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:30.666666 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397cb4eb-4ab1-4b95-a725-1134dea1faf9 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:30.669631 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:30.705712 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36118699-db62-4751-9e05-d697e7dc0988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:30.706336 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36118699-db62-4751-9e05-d697e7dc0988 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:30.706527 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36118699-db62-4751-9e05-d697e7dc0988 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:30.706793 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36118699-db62-4751-9e05-d697e7dc0988 None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:30.707476 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36118699-db62-4751-9e05-d697e7dc0988 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:03:30.707772 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36118699-db62-4751-9e05-d697e7dc0988 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:30.709154 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36118699-db62-4751-9e05-d697e7dc0988 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:30.723853 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 440/859] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 04:03:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:03:30.729714 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412f859-a935-43f8-a08c-42b8da0435b6 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:30.847776 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412f859-a935-43f8-a08c-42b8da0435b6 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:30.885667 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903b43f-262c-4c37-b5d2-6f50d5e9549d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:30.886294 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903b43f-262c-4c37-b5d2-6f50d5e9549d None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:30.886571 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903b43f-262c-4c37-b5d2-6f50d5e9549d None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:30.886831 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903b43f-262c-4c37-b5d2-6f50d5e9549d None admin] PATH_INFO: `/v3/users/placement` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:30.890814 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:30.897061 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1903b43f-262c-4c37-b5d2-6f50d5e9549d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:30.898865 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1903b43f-262c-4c37-b5d2-6f50d5e9549d None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:30.911785 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-1903b43f-262c-4c37-b5d2-6f50d5e9549d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:03:30.911785 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:03:30.911785 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:03:30.911785 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:03:30.911785 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:03:30.911785 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:03:30.911785 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:03:30.911785 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:03:30.911785 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:03:30.911785 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:03:30.911785 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:03:30.911785 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:03:30.911785 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:03:30.911785 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:03:30.911785 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:03:30.911785 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:03:30.913238 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:03:30.913238 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:03:30.913238 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:03:30.913238 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:03:30.913238 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:03:30.913238 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:03:30.913238 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:03:30.913238 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:03:30.913238 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:03:30.913238 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:03:30.913238 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:03:30.913238 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:03:30.913238 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:03:30.913238 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:03:30.913238 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:03:30.913238 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:03:30.913238 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:03:30.913238 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:03:30.914640 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:03:30.914640 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:03:30.914640 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:03:30.914640 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:03:30.914640 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:03:30.914640 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:03:30.914640 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:03:30.914640 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:03:30.914640 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:03:30.914640 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:03:30.914640 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 420/860] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:03:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:03:30.920186 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36118699-db62-4751-9e05-d697e7dc0988 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:31.051066 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36118699-db62-4751-9e05-d697e7dc0988 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:31.093748 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be836999-79b7-45fe-9837-857ad22c4a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:31.094739 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be836999-79b7-45fe-9837-857ad22c4a1d None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:31.095435 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be836999-79b7-45fe-9837-857ad22c4a1d None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:31.095748 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be836999-79b7-45fe-9837-857ad22c4a1d None admin] PATH_INFO: `/v3/users` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:31.096569 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be836999-79b7-45fe-9837-857ad22c4a1d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:03:31.097162 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be836999-79b7-45fe-9837-857ad22c4a1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:31.098405 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be836999-79b7-45fe-9837-857ad22c4a1d None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:31.117826 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 441/861] 10.222.0.15 () {56 vars in 1143 bytes} [Wed Aug 24 04:03:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:03:31.123812 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903b43f-262c-4c37-b5d2-6f50d5e9549d None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:31.240294 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903b43f-262c-4c37-b5d2-6f50d5e9549d None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:31.281892 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2ea6b-ecb0-4c36-8de3-c2049361c9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:31.282745 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2ea6b-ecb0-4c36-8de3-c2049361c9a3 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:31.283057 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2ea6b-ecb0-4c36-8de3-c2049361c9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:31.283369 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2ea6b-ecb0-4c36-8de3-c2049361c9a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:31.356756 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:31.364590 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2ea6b-ecb0-4c36-8de3-c2049361c9a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:31.366265 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2ea6b-ecb0-4c36-8de3-c2049361c9a3 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:31.489055 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 421/862] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 24 04:03:31 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:03:31.495789 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be836999-79b7-45fe-9837-857ad22c4a1d None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:31.524637 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:31.608376 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be836999-79b7-45fe-9837-857ad22c4a1d None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:31.649111 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2033e2-1fa1-4cab-8de5-b202cbd15a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:31.649758 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2033e2-1fa1-4cab-8de5-b202cbd15a32 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:31.650039 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2033e2-1fa1-4cab-8de5-b202cbd15a32 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:31.650310 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2033e2-1fa1-4cab-8de5-b202cbd15a32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:31.663490 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2033e2-1fa1-4cab-8de5-b202cbd15a32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:31.665274 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2033e2-1fa1-4cab-8de5-b202cbd15a32 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:31.683589 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-bc2033e2-1fa1-4cab-8de5-b202cbd15a32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:03:31.683589 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:03:31.683589 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:03:31.683589 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:03:31.683589 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:03:31.683589 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:03:31.683589 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:03:31.683589 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:03:31.683589 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:03:31.683589 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:03:31.683589 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:03:31.683589 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:03:31.683589 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:03:31.683589 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:03:31.683589 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:03:31.683589 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:03:31.685446 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:03:31.685446 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:03:31.685446 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:03:31.685446 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:03:31.685446 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:03:31.685446 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:03:31.685446 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:03:31.685446 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:03:31.685446 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:03:31.685446 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:03:31.685446 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:03:31.685446 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:03:31.685446 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:03:31.685446 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:03:31.685446 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:03:31.685446 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:03:31.685446 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:03:31.686897 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:03:31.686897 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:03:31.686897 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:03:31.686897 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 442/863] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:03:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:03:31.692620 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2ea6b-ecb0-4c36-8de3-c2049361c9a3 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:31.814819 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:31.821983 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2ea6b-ecb0-4c36-8de3-c2049361c9a3 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:31.862157 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60368b59-f539-4c20-b889-a567b73c4791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:31.862782 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60368b59-f539-4c20-b889-a567b73c4791 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:31.863121 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60368b59-f539-4c20-b889-a567b73c4791 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:31.863424 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60368b59-f539-4c20-b889-a567b73c4791 None admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:31.864060 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60368b59-f539-4c20-b889-a567b73c4791 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:03:31.864363 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60368b59-f539-4c20-b889-a567b73c4791 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:31.865734 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60368b59-f539-4c20-b889-a567b73c4791 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:31.879425 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 422/864] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 04:03:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:03:31.886144 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2033e2-1fa1-4cab-8de5-b202cbd15a32 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:31.979656 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:32.025579 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2033e2-1fa1-4cab-8de5-b202cbd15a32 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:32.068014 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff663b9-a3aa-48f1-88ee-a769ab297d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:32.068647 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff663b9-a3aa-48f1-88ee-a769ab297d9e None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:32.068919 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff663b9-a3aa-48f1-88ee-a769ab297d9e None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:32.069186 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff663b9-a3aa-48f1-88ee-a769ab297d9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:32.078966 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff663b9-a3aa-48f1-88ee-a769ab297d9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:32.080537 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff663b9-a3aa-48f1-88ee-a769ab297d9e None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:32.093512 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-2ff663b9-a3aa-48f1-88ee-a769ab297d9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:03:32.093512 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:03:32.093512 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:03:32.093512 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:03:32.093512 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:03:32.093512 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:03:32.093512 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:03:32.093512 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:03:32.093512 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:03:32.093512 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:03:32.093512 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:03:32.093512 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:03:32.093512 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:03:32.093512 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:03:32.093512 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:03:32.094985 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:03:32.094985 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:03:32.094985 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:03:32.094985 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:03:32.094985 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:03:32.094985 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:03:32.094985 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:03:32.094985 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:03:32.094985 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:03:32.094985 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:03:32.094985 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:03:32.094985 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:03:32.094985 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:03:32.094985 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:03:32.094985 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:03:32.094985 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:03:32.094985 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:03:32.096132 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:03:32.096132 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:03:32.096132 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:03:32.096132 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:03:32.096132 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:03:32.096132 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:03:32.096132 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:03:32.096132 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:03:32.096132 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 443/865] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 24 04:03:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:03:32.103086 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60368b59-f539-4c20-b889-a567b73c4791 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:32.235601 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60368b59-f539-4c20-b889-a567b73c4791 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:32.275853 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf5d79-08e8-4a76-97d1-9759c8207404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:32.276473 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf5d79-08e8-4a76-97d1-9759c8207404 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:32.276748 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf5d79-08e8-4a76-97d1-9759c8207404 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:32.277188 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf5d79-08e8-4a76-97d1-9759c8207404 None admin] PATH_INFO: `/v3/projects` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:32.277913 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf5d79-08e8-4a76-97d1-9759c8207404 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:03:32.278219 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf5d79-08e8-4a76-97d1-9759c8207404 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:32.279694 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf5d79-08e8-4a76-97d1-9759c8207404 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:32.295767 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 423/866] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 24 04:03:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:03:32.302576 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff663b9-a3aa-48f1-88ee-a769ab297d9e None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:32.448327 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff663b9-a3aa-48f1-88ee-a769ab297d9e None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:32.494890 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90f3744-05f2-4b03-9e22-92a5a2c708d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:32.495458 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f3744-05f2-4b03-9e22-92a5a2c708d1 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:32.495734 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f3744-05f2-4b03-9e22-92a5a2c708d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:32.496002 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f3744-05f2-4b03-9e22-92a5a2c708d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:32.496745 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90f3744-05f2-4b03-9e22-92a5a2c708d1 None admin] RBAC: Adding query filter params (role.id=4278d3d9834d462b821b63a99db9229a, scope.project.id=5c317b3ce1d1468f95bc01ba2587e623, user.id=a3f34384ad354405a69b3cfa242e9504) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:03:32.497050 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90f3744-05f2-4b03-9e22-92a5a2c708d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:32.498636 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90f3744-05f2-4b03-9e22-92a5a2c708d1 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:32.501005 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:32.508399 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 444/867] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 24 04:03:32 2022] GET /identity/v3/role_assignments?user.id=a3f34384ad354405a69b3cfa242e9504&scope.project.id=5c317b3ce1d1468f95bc01ba2587e623&role.id=4278d3d9834d462b821b63a99db9229a => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:03:34.946223 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805d41d-fdd0-4c08-9439-3d8c7f012922 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:34.947529 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805d41d-fdd0-4c08-9439-3d8c7f012922 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:34.947529 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805d41d-fdd0-4c08-9439-3d8c7f012922 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:34.948171 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 424/868] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:03:34.954521 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc954d7d-da3a-4527-951a-958c822e993c None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:34.955236 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc954d7d-da3a-4527-951a-958c822e993c None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:34.955236 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc954d7d-da3a-4527-951a-958c822e993c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:34.981069 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-cc954d7d-da3a-4527-951a-958c822e993c None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:03:34.983084 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-cc954d7d-da3a-4527-951a-958c822e993c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:03:35.078226 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 445/869] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:03:34 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:03:35.403127 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805d41d-fdd0-4c08-9439-3d8c7f012922 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:35.424598 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:35.554209 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805d41d-fdd0-4c08-9439-3d8c7f012922 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:35.591295 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebdac18-e0b3-4e78-97f5-ef0070af6839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:35.591931 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebdac18-e0b3-4e78-97f5-ef0070af6839 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:35.592210 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebdac18-e0b3-4e78-97f5-ef0070af6839 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:35.592480 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebdac18-e0b3-4e78-97f5-ef0070af6839 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:35.611878 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebdac18-e0b3-4e78-97f5-ef0070af6839 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:03:35.618743 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-8ebdac18-e0b3-4e78-97f5-ef0070af6839 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:03:35.618743 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:03:35.618743 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:03:35.618743 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:03:35.618743 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:03:35.618743 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:03:35.618743 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:03:35.618743 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:03:35.618743 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:03:35.618743 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:03:35.618743 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:03:35.618743 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:03:35.618743 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:03:35.618743 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:03:35.618743 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:03:35.618743 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:03:35.619844 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:03:35.619844 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:03:35.619844 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:03:35.619844 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:03:35.619844 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:03:35.619844 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:03:35.619844 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:03:35.619844 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:03:35.619844 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:03:35.619844 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:03:35.619844 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:03:35.619844 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:03:35.619844 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:03:35.619844 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:03:35.619844 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:03:35.619844 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:03:35.620778 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:03:35.620778 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:03:35.620778 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:03:35.620778 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:03:35.620778 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:03:35.620778 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:03:35.620778 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:03:35.620778 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:03:35.620778 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:03:35.620778 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:03:35.620778 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:03:35.620778 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:03:35.621439 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 425/870] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 24 04:03:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:03:35.629049 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc954d7d-da3a-4527-951a-958c822e993c None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:35.745061 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc954d7d-da3a-4527-951a-958c822e993c None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:35.779868 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:35.788790 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de348dfb-76cf-4502-bd8b-cfa2bed25518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:35.789566 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de348dfb-76cf-4502-bd8b-cfa2bed25518 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:35.790176 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de348dfb-76cf-4502-bd8b-cfa2bed25518 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:35.790451 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de348dfb-76cf-4502-bd8b-cfa2bed25518 None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:35.791137 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de348dfb-76cf-4502-bd8b-cfa2bed25518 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:03:35.791475 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de348dfb-76cf-4502-bd8b-cfa2bed25518 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:35.792863 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de348dfb-76cf-4502-bd8b-cfa2bed25518 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:35.803237 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 446/871] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 04:03:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:03:35.810719 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebdac18-e0b3-4e78-97f5-ef0070af6839 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:35.906187 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:35.938677 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebdac18-e0b3-4e78-97f5-ef0070af6839 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:35.988090 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ced64-2deb-4af4-aa1f-6dcefe93fd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:35.988924 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ced64-2deb-4af4-aa1f-6dcefe93fd16 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:35.989390 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ced64-2deb-4af4-aa1f-6dcefe93fd16 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:35.989705 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ced64-2deb-4af4-aa1f-6dcefe93fd16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:36.004625 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ced64-2deb-4af4-aa1f-6dcefe93fd16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:36.006766 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ced64-2deb-4af4-aa1f-6dcefe93fd16 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:36.026647 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-505ced64-2deb-4af4-aa1f-6dcefe93fd16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:03:36.026647 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:03:36.026647 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:03:36.026647 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:03:36.026647 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:03:36.026647 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:03:36.026647 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:03:36.026647 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:03:36.026647 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:03:36.026647 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:03:36.026647 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:03:36.026647 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:03:36.026647 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:03:36.026647 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:03:36.026647 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:03:36.026647 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:03:36.028062 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:03:36.028062 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:03:36.028062 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:03:36.028062 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:03:36.028062 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:03:36.028062 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:03:36.028062 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:03:36.028062 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:03:36.028062 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:03:36.028062 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:03:36.028062 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:03:36.028062 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:03:36.028062 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:03:36.028062 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:03:36.028062 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:03:36.028062 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:03:36.028062 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:03:36.029185 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:03:36.029185 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:03:36.029185 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:03:36.029185 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 426/872] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:03:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:03:36.033905 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de348dfb-76cf-4502-bd8b-cfa2bed25518 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:36.156889 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de348dfb-76cf-4502-bd8b-cfa2bed25518 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:36.204448 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ab013-8ea9-472b-958c-0d60bcc239e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:36.205247 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ab013-8ea9-472b-958c-0d60bcc239e2 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:36.205524 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ab013-8ea9-472b-958c-0d60bcc239e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:36.205793 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ab013-8ea9-472b-958c-0d60bcc239e2 None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:36.206457 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7ab013-8ea9-472b-958c-0d60bcc239e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:03:36.206756 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7ab013-8ea9-472b-958c-0d60bcc239e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:36.208283 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7ab013-8ea9-472b-958c-0d60bcc239e2 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:36.223673 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 447/873] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 04:03:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:03:36.230034 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ced64-2deb-4af4-aa1f-6dcefe93fd16 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:36.372181 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ced64-2deb-4af4-aa1f-6dcefe93fd16 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:36.403346 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:36.413572 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20b7d2-0eb9-4511-a077-f1b1d3b669ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:36.414346 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20b7d2-0eb9-4511-a077-f1b1d3b669ba None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:36.414651 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20b7d2-0eb9-4511-a077-f1b1d3b669ba None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:36.415051 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20b7d2-0eb9-4511-a077-f1b1d3b669ba None admin] PATH_INFO: `/v3/users/placement` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:36.424129 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e20b7d2-0eb9-4511-a077-f1b1d3b669ba None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:36.425762 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e20b7d2-0eb9-4511-a077-f1b1d3b669ba None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:36.438677 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-9e20b7d2-0eb9-4511-a077-f1b1d3b669ba None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:03:36.438677 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:03:36.438677 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:03:36.438677 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:03:36.438677 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:03:36.438677 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:03:36.438677 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:03:36.438677 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:03:36.438677 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:03:36.438677 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:03:36.438677 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:03:36.438677 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:03:36.438677 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:03:36.438677 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:03:36.438677 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:03:36.438677 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:03:36.439778 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:03:36.439778 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:03:36.439778 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:03:36.439778 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:03:36.439778 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:03:36.439778 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:03:36.439778 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:03:36.439778 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:03:36.439778 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:03:36.439778 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:03:36.439778 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:03:36.439778 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:03:36.439778 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:03:36.439778 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:03:36.439778 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:03:36.439778 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:03:36.439778 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:03:36.439778 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:03:36.441234 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:03:36.441234 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:03:36.441234 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:03:36.441234 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:03:36.441234 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:03:36.441234 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:03:36.441234 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:03:36.441234 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:03:36.441234 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:03:36.441234 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:03:36.441234 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 427/874] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:03:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:03:36.446700 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ab013-8ea9-472b-958c-0d60bcc239e2 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:36.511036 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:36.574529 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ab013-8ea9-472b-958c-0d60bcc239e2 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:36.615156 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de6934-10c2-4fa4-a52b-1defc5ad402b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:36.615817 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de6934-10c2-4fa4-a52b-1defc5ad402b None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:36.616102 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de6934-10c2-4fa4-a52b-1defc5ad402b None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:36.616369 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de6934-10c2-4fa4-a52b-1defc5ad402b None admin] PATH_INFO: `/v3/users` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:36.617113 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de6934-10c2-4fa4-a52b-1defc5ad402b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:03:36.617420 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de6934-10c2-4fa4-a52b-1defc5ad402b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:36.618874 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de6934-10c2-4fa4-a52b-1defc5ad402b None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:36.637627 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 448/875] 10.222.0.15 () {56 vars in 1143 bytes} [Wed Aug 24 04:03:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:03:36.645031 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20b7d2-0eb9-4511-a077-f1b1d3b669ba None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:36.796042 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20b7d2-0eb9-4511-a077-f1b1d3b669ba None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:36.847902 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3b9ab-4e09-4316-a49a-b61305a0277a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:36.848535 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3b9ab-4e09-4316-a49a-b61305a0277a None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:36.848810 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3b9ab-4e09-4316-a49a-b61305a0277a None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:36.849077 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3b9ab-4e09-4316-a49a-b61305a0277a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:36.938695 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:36.960339 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3b9ab-4e09-4316-a49a-b61305a0277a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:36.962008 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3b9ab-4e09-4316-a49a-b61305a0277a None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:37.098293 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 428/876] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 24 04:03:36 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:03:37.107672 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de6934-10c2-4fa4-a52b-1defc5ad402b None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:37.247720 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de6934-10c2-4fa4-a52b-1defc5ad402b None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:37.259767 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:37.311536 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3a919-a3c9-4bba-beff-1685ced50b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:37.312179 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3a919-a3c9-4bba-beff-1685ced50b84 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:37.312456 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3a919-a3c9-4bba-beff-1685ced50b84 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:37.312724 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3a919-a3c9-4bba-beff-1685ced50b84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:37.325898 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf3a919-a3c9-4bba-beff-1685ced50b84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:37.327705 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf3a919-a3c9-4bba-beff-1685ced50b84 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:37.345787 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-ecf3a919-a3c9-4bba-beff-1685ced50b84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:03:37.345787 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:03:37.345787 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:03:37.345787 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:03:37.345787 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:03:37.345787 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:03:37.345787 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:03:37.345787 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:03:37.345787 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:03:37.345787 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:03:37.345787 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:03:37.345787 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:03:37.345787 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:03:37.345787 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:03:37.345787 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:03:37.345787 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:03:37.347179 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:03:37.347179 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:03:37.347179 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:03:37.347179 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:03:37.347179 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:03:37.347179 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:03:37.347179 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:03:37.347179 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:03:37.347179 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:03:37.347179 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:03:37.347179 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:03:37.347179 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:03:37.347179 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:03:37.347179 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:03:37.347179 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:03:37.347179 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:03:37.347179 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:03:37.348408 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:03:37.348408 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:03:37.348408 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:03:37.348408 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 449/877] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:03:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:03:37.354275 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3b9ab-4e09-4316-a49a-b61305a0277a None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:37.477117 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:37.491739 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3b9ab-4e09-4316-a49a-b61305a0277a None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:37.538027 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8edd6-b1af-4dd9-bdd3-ead7229f65e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:37.538637 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8edd6-b1af-4dd9-bdd3-ead7229f65e4 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:37.538906 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8edd6-b1af-4dd9-bdd3-ead7229f65e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:37.539170 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8edd6-b1af-4dd9-bdd3-ead7229f65e4 None admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:37.539906 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e8edd6-b1af-4dd9-bdd3-ead7229f65e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:03:37.540203 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e8edd6-b1af-4dd9-bdd3-ead7229f65e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:37.541628 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e8edd6-b1af-4dd9-bdd3-ead7229f65e4 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:37.554890 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 429/878] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 04:03:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:03:37.561269 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3a919-a3c9-4bba-beff-1685ced50b84 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:37.693802 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3a919-a3c9-4bba-beff-1685ced50b84 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:37.736403 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd5c9b-973c-480e-bbaa-1638b684f5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:37.737037 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd5c9b-973c-480e-bbaa-1638b684f5ea None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:37.737421 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd5c9b-973c-480e-bbaa-1638b684f5ea None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:37.737676 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd5c9b-973c-480e-bbaa-1638b684f5ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:37.746216 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd5c9b-973c-480e-bbaa-1638b684f5ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:37.747876 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd5c9b-973c-480e-bbaa-1638b684f5ea None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:37.760860 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-e0fd5c9b-973c-480e-bbaa-1638b684f5ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:03:37.760860 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:03:37.760860 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:03:37.760860 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:03:37.760860 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:03:37.760860 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:03:37.760860 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:03:37.760860 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:03:37.760860 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:03:37.760860 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:03:37.760860 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:03:37.760860 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:03:37.760860 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:03:37.760860 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:03:37.760860 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:03:37.762361 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:03:37.762361 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:03:37.762361 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:03:37.762361 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:03:37.762361 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:03:37.762361 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:03:37.762361 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:03:37.762361 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:03:37.762361 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:03:37.762361 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:03:37.762361 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:03:37.762361 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:03:37.762361 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:03:37.762361 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:03:37.762361 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:03:37.762361 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:03:37.762361 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:03:37.763803 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:03:37.763803 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:03:37.763803 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:03:37.763803 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:03:37.763803 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:03:37.763803 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:03:37.763803 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:03:37.763803 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:03:37.763803 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 450/879] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 24 04:03:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:03:37.770291 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8edd6-b1af-4dd9-bdd3-ead7229f65e4 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:37.886307 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8edd6-b1af-4dd9-bdd3-ead7229f65e4 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:37.943510 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeea9d2-d4cf-40de-819a-105e678b7f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:37.944225 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeea9d2-d4cf-40de-819a-105e678b7f3c None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:37.944397 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeea9d2-d4cf-40de-819a-105e678b7f3c None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:37.944672 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeea9d2-d4cf-40de-819a-105e678b7f3c None admin] PATH_INFO: `/v3/projects` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:37.945419 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeea9d2-d4cf-40de-819a-105e678b7f3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:03:37.945874 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeea9d2-d4cf-40de-819a-105e678b7f3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:37.947327 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeea9d2-d4cf-40de-819a-105e678b7f3c None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:37.962385 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 430/880] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 24 04:03:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:03:37.969421 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd5c9b-973c-480e-bbaa-1638b684f5ea None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:37.995562 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:38.103803 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd5c9b-973c-480e-bbaa-1638b684f5ea None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:38.147481 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f41f76-7dc2-408a-b5c3-d4eed7e7cba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:38.148355 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f41f76-7dc2-408a-b5c3-d4eed7e7cba6 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:38.148355 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f41f76-7dc2-408a-b5c3-d4eed7e7cba6 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:38.148611 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f41f76-7dc2-408a-b5c3-d4eed7e7cba6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:38.149665 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f41f76-7dc2-408a-b5c3-d4eed7e7cba6 None admin] RBAC: Adding query filter params (role.id=df6a8bb215d54f71a0b6988a9c01f5e4, scope.project.id=5c317b3ce1d1468f95bc01ba2587e623, user.id=a3f34384ad354405a69b3cfa242e9504) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:03:38.150019 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f41f76-7dc2-408a-b5c3-d4eed7e7cba6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:38.157444 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f41f76-7dc2-408a-b5c3-d4eed7e7cba6 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:38.179234 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 451/881] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 24 04:03:37 2022] GET /identity/v3/role_assignments?user.id=a3f34384ad354405a69b3cfa242e9504&scope.project.id=5c317b3ce1d1468f95bc01ba2587e623&role.id=df6a8bb215d54f71a0b6988a9c01f5e4 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:03:40.441493 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4c821-47ee-49fb-b6e6-1d32263ef41c None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:40.442365 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4c821-47ee-49fb-b6e6-1d32263ef41c None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:40.442365 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4c821-47ee-49fb-b6e6-1d32263ef41c None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:40.443970 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 431/882] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:03:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:03:40.452305 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d53daa-392f-47a8-b918-b68a34350c34 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:40.452858 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d53daa-392f-47a8-b918-b68a34350c34 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:40.453024 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d53daa-392f-47a8-b918-b68a34350c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:40.476828 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-75d53daa-392f-47a8-b918-b68a34350c34 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:03:40.478071 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-75d53daa-392f-47a8-b918-b68a34350c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:03:40.548310 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 452/883] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:03:40 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:03:40.875884 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4c821-47ee-49fb-b6e6-1d32263ef41c None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:40.888078 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:41.008342 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4c821-47ee-49fb-b6e6-1d32263ef41c None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:41.055936 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff2e7c-0457-4778-94b9-5b021ae21466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:41.058994 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff2e7c-0457-4778-94b9-5b021ae21466 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:41.058994 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff2e7c-0457-4778-94b9-5b021ae21466 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:41.058994 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff2e7c-0457-4778-94b9-5b021ae21466 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:41.071092 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dff2e7c-0457-4778-94b9-5b021ae21466 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:03:41.075836 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-1dff2e7c-0457-4778-94b9-5b021ae21466 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:03:41.075836 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:03:41.075836 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:03:41.075836 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:03:41.075836 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:03:41.075836 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:03:41.075836 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:03:41.075836 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:03:41.075836 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:03:41.075836 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:03:41.075836 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:03:41.075836 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:03:41.075836 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:03:41.075836 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:03:41.075836 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:03:41.075836 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:03:41.076949 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:03:41.076949 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:03:41.076949 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:03:41.076949 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:03:41.076949 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:03:41.076949 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:03:41.076949 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:03:41.076949 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:03:41.076949 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:03:41.076949 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:03:41.076949 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:03:41.076949 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:03:41.076949 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:03:41.076949 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:03:41.076949 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:03:41.076949 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:03:41.077921 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:03:41.077921 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:03:41.077921 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:03:41.077921 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:03:41.077921 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:03:41.077921 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:03:41.077921 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:03:41.077921 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:03:41.077921 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:03:41.077921 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:03:41.077921 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:03:41.077921 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:03:41.077921 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 432/884] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 24 04:03:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:03:41.083582 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d53daa-392f-47a8-b918-b68a34350c34 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:41.100549 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:41.197975 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d53daa-392f-47a8-b918-b68a34350c34 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:41.237423 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcbffde-9b97-44de-b2d1-12234e0d2597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:41.238140 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbffde-9b97-44de-b2d1-12234e0d2597 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:41.238403 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbffde-9b97-44de-b2d1-12234e0d2597 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:41.238948 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbffde-9b97-44de-b2d1-12234e0d2597 None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:41.239747 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcbffde-9b97-44de-b2d1-12234e0d2597 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:03:41.240091 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcbffde-9b97-44de-b2d1-12234e0d2597 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:41.242334 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcbffde-9b97-44de-b2d1-12234e0d2597 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:41.252626 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 453/885] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 04:03:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:03:41.258467 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff2e7c-0457-4778-94b9-5b021ae21466 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:41.332090 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:41.367104 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff2e7c-0457-4778-94b9-5b021ae21466 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:41.401302 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5632d-6e6d-4fbc-8d24-df7ab11b7ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:41.401923 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5632d-6e6d-4fbc-8d24-df7ab11b7ea7 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:41.402198 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5632d-6e6d-4fbc-8d24-df7ab11b7ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:41.402487 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5632d-6e6d-4fbc-8d24-df7ab11b7ea7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:41.413106 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f5632d-6e6d-4fbc-8d24-df7ab11b7ea7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:41.414577 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f5632d-6e6d-4fbc-8d24-df7ab11b7ea7 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:41.430275 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-c0f5632d-6e6d-4fbc-8d24-df7ab11b7ea7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:03:41.430275 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:03:41.430275 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:03:41.430275 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:03:41.430275 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:03:41.430275 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:03:41.430275 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:03:41.430275 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:03:41.430275 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:03:41.430275 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:03:41.430275 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:03:41.430275 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:03:41.430275 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:03:41.430275 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:03:41.430275 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:03:41.430275 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:03:41.431320 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:03:41.431320 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:03:41.431320 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:03:41.431320 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:03:41.431320 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:03:41.431320 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:03:41.431320 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:03:41.431320 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:03:41.431320 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:03:41.431320 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:03:41.431320 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:03:41.431320 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:03:41.431320 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:03:41.431320 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:03:41.431320 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:03:41.431320 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:03:41.431320 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:03:41.432366 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:03:41.432366 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:03:41.432366 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:03:41.432366 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 433/886] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:03:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:03:41.437708 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcbffde-9b97-44de-b2d1-12234e0d2597 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:41.523416 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:41.549141 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcbffde-9b97-44de-b2d1-12234e0d2597 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:41.589296 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981deede-84f4-4cb1-b582-c98d6a4cce4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:41.589939 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981deede-84f4-4cb1-b582-c98d6a4cce4b None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:41.590220 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981deede-84f4-4cb1-b582-c98d6a4cce4b None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:41.590490 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981deede-84f4-4cb1-b582-c98d6a4cce4b None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:41.591150 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981deede-84f4-4cb1-b582-c98d6a4cce4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:03:41.591755 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981deede-84f4-4cb1-b582-c98d6a4cce4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:41.593366 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981deede-84f4-4cb1-b582-c98d6a4cce4b None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:41.606984 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 454/887] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 04:03:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:03:41.613107 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5632d-6e6d-4fbc-8d24-df7ab11b7ea7 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:41.728202 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5632d-6e6d-4fbc-8d24-df7ab11b7ea7 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:41.750242 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:41.766534 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad0afc-6e2c-42c0-8297-798196f1c3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:41.767178 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad0afc-6e2c-42c0-8297-798196f1c3d9 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:41.767492 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad0afc-6e2c-42c0-8297-798196f1c3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:41.767769 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad0afc-6e2c-42c0-8297-798196f1c3d9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:41.776407 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ad0afc-6e2c-42c0-8297-798196f1c3d9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:41.777812 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ad0afc-6e2c-42c0-8297-798196f1c3d9 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:41.789909 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-b3ad0afc-6e2c-42c0-8297-798196f1c3d9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:03:41.789909 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:03:41.789909 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:03:41.789909 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:03:41.789909 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:03:41.789909 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:03:41.789909 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:03:41.789909 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:03:41.789909 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:03:41.789909 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:03:41.789909 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:03:41.789909 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:03:41.789909 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:03:41.789909 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:03:41.789909 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:03:41.789909 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:03:41.791079 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:03:41.791079 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:03:41.791079 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:03:41.791079 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:03:41.791079 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:03:41.791079 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:03:41.791079 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:03:41.791079 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:03:41.791079 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:03:41.791079 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:03:41.791079 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:03:41.791079 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:03:41.791079 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:03:41.791079 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:03:41.791079 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:03:41.791079 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:03:41.791079 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:03:41.791079 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:03:41.792373 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:03:41.792373 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:03:41.792373 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:03:41.792373 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:03:41.792373 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:03:41.792373 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:03:41.792373 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:03:41.792373 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:03:41.792373 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:03:41.792373 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:03:41.792373 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 434/888] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:03:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:03:41.798341 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981deede-84f4-4cb1-b582-c98d6a4cce4b None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:41.906667 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981deede-84f4-4cb1-b582-c98d6a4cce4b None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:41.942964 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a5f6a-6d70-4e49-b61f-39784470e383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:41.943605 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a5f6a-6d70-4e49-b61f-39784470e383 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:41.943890 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a5f6a-6d70-4e49-b61f-39784470e383 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:41.944146 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a5f6a-6d70-4e49-b61f-39784470e383 None admin] PATH_INFO: `/v3/users` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:41.944885 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266a5f6a-6d70-4e49-b61f-39784470e383 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:03:41.945197 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266a5f6a-6d70-4e49-b61f-39784470e383 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:41.946645 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266a5f6a-6d70-4e49-b61f-39784470e383 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:41.952000 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:41.969259 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 455/889] 10.222.0.15 () {56 vars in 1143 bytes} [Wed Aug 24 04:03:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:03:41.975662 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad0afc-6e2c-42c0-8297-798196f1c3d9 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:42.092373 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad0afc-6e2c-42c0-8297-798196f1c3d9 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:42.128557 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd0819-0fc6-4038-a2d0-eb284afd4deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:42.129181 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd0819-0fc6-4038-a2d0-eb284afd4deb None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:42.129455 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd0819-0fc6-4038-a2d0-eb284afd4deb None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:42.129724 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd0819-0fc6-4038-a2d0-eb284afd4deb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:42.141089 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd0819-0fc6-4038-a2d0-eb284afd4deb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:42.142625 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd0819-0fc6-4038-a2d0-eb284afd4deb None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:42.157307 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-20cd0819-0fc6-4038-a2d0-eb284afd4deb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:03:42.157307 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:03:42.157307 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:03:42.157307 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:03:42.157307 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:03:42.157307 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:03:42.157307 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:03:42.157307 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:03:42.157307 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:03:42.157307 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:03:42.157307 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:03:42.157307 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:03:42.157307 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:03:42.157307 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:03:42.157307 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:03:42.157307 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:03:42.158864 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:03:42.158864 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:03:42.158864 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:03:42.158864 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:03:42.158864 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:03:42.158864 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:03:42.158864 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:03:42.158864 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:03:42.158864 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:03:42.158864 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:03:42.158864 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:03:42.158864 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:03:42.158864 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:03:42.158864 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:03:42.158864 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:03:42.158864 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:03:42.158864 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:03:42.160627 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:03:42.160627 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:03:42.160627 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:03:42.160627 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 435/890] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:03:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:03:42.164446 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a5f6a-6d70-4e49-b61f-39784470e383 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:42.273002 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a5f6a-6d70-4e49-b61f-39784470e383 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:42.310401 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26099ab-5aeb-4305-840c-b3e5e1da4297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:42.311008 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26099ab-5aeb-4305-840c-b3e5e1da4297 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:42.311319 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26099ab-5aeb-4305-840c-b3e5e1da4297 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:42.311577 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26099ab-5aeb-4305-840c-b3e5e1da4297 None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:42.312256 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26099ab-5aeb-4305-840c-b3e5e1da4297 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:03:42.312563 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26099ab-5aeb-4305-840c-b3e5e1da4297 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:42.314016 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26099ab-5aeb-4305-840c-b3e5e1da4297 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:42.326894 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 456/891] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 04:03:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:03:42.332826 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd0819-0fc6-4038-a2d0-eb284afd4deb None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:42.372908 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:42.460156 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd0819-0fc6-4038-a2d0-eb284afd4deb None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:42.496076 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af24bd6-e87f-4fef-b489-a3f9a5cd8678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:42.496711 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af24bd6-e87f-4fef-b489-a3f9a5cd8678 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:42.496986 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af24bd6-e87f-4fef-b489-a3f9a5cd8678 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:42.497257 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af24bd6-e87f-4fef-b489-a3f9a5cd8678 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:42.508112 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af24bd6-e87f-4fef-b489-a3f9a5cd8678 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:42.509785 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af24bd6-e87f-4fef-b489-a3f9a5cd8678 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:42.522501 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-0af24bd6-e87f-4fef-b489-a3f9a5cd8678 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:03:42.522501 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:03:42.522501 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:03:42.522501 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:03:42.522501 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:03:42.522501 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:03:42.522501 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:03:42.522501 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:03:42.522501 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:03:42.522501 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:03:42.522501 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:03:42.522501 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:03:42.522501 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:03:42.522501 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:03:42.522501 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:03:42.526647 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:03:42.526647 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:03:42.526647 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:03:42.526647 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:03:42.526647 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:03:42.526647 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:03:42.526647 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:03:42.526647 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:03:42.526647 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:03:42.526647 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:03:42.526647 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:03:42.526647 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:03:42.526647 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:03:42.526647 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:03:42.526647 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:03:42.526647 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:03:42.526647 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:03:42.527888 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:03:42.527888 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:03:42.527888 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:03:42.527888 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:03:42.527888 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:03:42.527888 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:03:42.527888 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:03:42.527888 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:03:42.527888 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 436/892] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 24 04:03:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:03:42.531646 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26099ab-5aeb-4305-840c-b3e5e1da4297 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:42.590774 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:42.642063 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26099ab-5aeb-4305-840c-b3e5e1da4297 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:42.681719 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d7533-2262-4691-a135-0b383bb7cb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:42.682328 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d7533-2262-4691-a135-0b383bb7cb1e None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:42.682609 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d7533-2262-4691-a135-0b383bb7cb1e None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:42.682883 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d7533-2262-4691-a135-0b383bb7cb1e None admin] PATH_INFO: `/v3/projects` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:42.683708 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d7533-2262-4691-a135-0b383bb7cb1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:03:42.683994 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d7533-2262-4691-a135-0b383bb7cb1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:42.685503 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d7533-2262-4691-a135-0b383bb7cb1e None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:42.699831 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 457/893] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 24 04:03:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:03:42.706607 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af24bd6-e87f-4fef-b489-a3f9a5cd8678 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:42.813414 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:42.824766 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af24bd6-e87f-4fef-b489-a3f9a5cd8678 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:42.866231 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d43c33-2f33-4494-9214-db707c88ed11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:42.867181 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d43c33-2f33-4494-9214-db707c88ed11 None admin] REQUEST_METHOD: `PUT` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:42.867545 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d43c33-2f33-4494-9214-db707c88ed11 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:42.867873 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d43c33-2f33-4494-9214-db707c88ed11 None admin] PATH_INFO: `/v3/projects/5c317b3ce1d1468f95bc01ba2587e623/users/a3f34384ad354405a69b3cfa242e9504/roles/df6a8bb215d54f71a0b6988a9c01f5e4` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:42.869954 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d43c33-2f33-4494-9214-db707c88ed11 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c317b3ce1d1468f95bc01ba2587e623, user_id=a3f34384ad354405a69b3cfa242e9504, role_id=df6a8bb215d54f71a0b6988a9c01f5e4)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:42.871508 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d43c33-2f33-4494-9214-db707c88ed11 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:42.889046 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 437/894] 10.222.0.15 () {58 vars in 1439 bytes} [Wed Aug 24 04:03:42 2022] PUT /identity/v3/projects/5c317b3ce1d1468f95bc01ba2587e623/users/a3f34384ad354405a69b3cfa242e9504/roles/df6a8bb215d54f71a0b6988a9c01f5e4 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:03:45.355079 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b46427-07ff-4efd-a11c-f5587dcf678d None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:45.355800 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b46427-07ff-4efd-a11c-f5587dcf678d None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:45.355800 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b46427-07ff-4efd-a11c-f5587dcf678d None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:45.357002 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 458/895] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:03:45.363096 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344d0f4-6c55-4ae3-a629-f364d3a4e489 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:45.363760 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344d0f4-6c55-4ae3-a629-f364d3a4e489 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:45.363760 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344d0f4-6c55-4ae3-a629-f364d3a4e489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:45.382767 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-5344d0f4-6c55-4ae3-a629-f364d3a4e489 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:03:45.384032 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-5344d0f4-6c55-4ae3-a629-f364d3a4e489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:03:45.458586 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 438/896] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:03:45 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:03:45.781527 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b46427-07ff-4efd-a11c-f5587dcf678d None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:45.910126 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b46427-07ff-4efd-a11c-f5587dcf678d None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:45.926514 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:45.952278 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c932bfd9-a60b-4a95-ac48-057101190008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:45.953041 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932bfd9-a60b-4a95-ac48-057101190008 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:45.953404 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932bfd9-a60b-4a95-ac48-057101190008 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:45.953752 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932bfd9-a60b-4a95-ac48-057101190008 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:45.969865 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c932bfd9-a60b-4a95-ac48-057101190008 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:03:45.975991 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-c932bfd9-a60b-4a95-ac48-057101190008 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:03:45.975991 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:03:45.975991 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:03:45.975991 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:03:45.975991 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:03:45.975991 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:03:45.975991 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:03:45.975991 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:03:45.975991 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:03:45.975991 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:03:45.975991 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:03:45.975991 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:03:45.975991 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:03:45.975991 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:03:45.975991 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:03:45.975991 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:03:45.977181 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:03:45.977181 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:03:45.977181 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:03:45.977181 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:03:45.977181 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:03:45.977181 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:03:45.977181 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:03:45.977181 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:03:45.977181 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:03:45.977181 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:03:45.977181 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:03:45.977181 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:03:45.977181 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:03:45.977181 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:03:45.977181 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:03:45.977181 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:03:45.978618 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:03:45.978618 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:03:45.978618 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:03:45.978618 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:03:45.978618 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:03:45.978618 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:03:45.978618 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:03:45.978618 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:03:45.978618 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:03:45.978618 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:03:45.978618 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:03:45.978618 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:03:45.978618 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 459/897] 10.222.0.15 () {56 vars in 1096 bytes} [Wed Aug 24 04:03:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:03:45.985401 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344d0f4-6c55-4ae3-a629-f364d3a4e489 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:46.097032 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:46.124737 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344d0f4-6c55-4ae3-a629-f364d3a4e489 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:46.163348 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44443787-7ee6-424f-a69f-d76e1be6cdb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:46.163968 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44443787-7ee6-424f-a69f-d76e1be6cdb6 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:46.164249 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44443787-7ee6-424f-a69f-d76e1be6cdb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:46.164519 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44443787-7ee6-424f-a69f-d76e1be6cdb6 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:46.165193 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44443787-7ee6-424f-a69f-d76e1be6cdb6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:03:46.165495 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44443787-7ee6-424f-a69f-d76e1be6cdb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:46.166885 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44443787-7ee6-424f-a69f-d76e1be6cdb6 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:46.175790 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 439/898] 10.222.0.15 () {56 vars in 1099 bytes} [Wed Aug 24 04:03:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:03:46.182896 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c932bfd9-a60b-4a95-ac48-057101190008 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:46.289843 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c932bfd9-a60b-4a95-ac48-057101190008 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:46.334636 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ceb36-7239-4d89-a504-ba2a56f19e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:46.335604 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ceb36-7239-4d89-a504-ba2a56f19e94 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:46.336061 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ceb36-7239-4d89-a504-ba2a56f19e94 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:46.336341 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ceb36-7239-4d89-a504-ba2a56f19e94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:46.349481 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ceb36-7239-4d89-a504-ba2a56f19e94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:46.350870 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ceb36-7239-4d89-a504-ba2a56f19e94 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:46.368180 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-623ceb36-7239-4d89-a504-ba2a56f19e94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:03:46.368180 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:03:46.368180 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:03:46.368180 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:03:46.368180 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:03:46.368180 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:03:46.368180 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:03:46.368180 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:03:46.368180 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:03:46.368180 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:03:46.368180 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:03:46.368180 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:03:46.368180 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:03:46.368180 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:03:46.368180 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:03:46.368180 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:03:46.369965 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:03:46.369965 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:03:46.369965 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:03:46.369965 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:03:46.369965 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:03:46.369965 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:03:46.369965 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:03:46.369965 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:03:46.369965 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:03:46.369965 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:03:46.369965 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:03:46.369965 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:03:46.369965 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:03:46.369965 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:03:46.369965 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:03:46.369965 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:03:46.369965 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:03:46.371130 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:03:46.371130 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:03:46.371130 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:03:46.371130 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 460/899] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:03:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:03:46.376586 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44443787-7ee6-424f-a69f-d76e1be6cdb6 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:46.486885 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44443787-7ee6-424f-a69f-d76e1be6cdb6 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:46.525829 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b5532a-854d-4b41-92f4-8a3087ce7fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:46.526434 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5532a-854d-4b41-92f4-8a3087ce7fa2 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:46.526718 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5532a-854d-4b41-92f4-8a3087ce7fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:46.527003 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5532a-854d-4b41-92f4-8a3087ce7fa2 None admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:46.527679 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b5532a-854d-4b41-92f4-8a3087ce7fa2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:03:46.527982 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b5532a-854d-4b41-92f4-8a3087ce7fa2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:46.529368 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b5532a-854d-4b41-92f4-8a3087ce7fa2 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:46.541954 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 440/900] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 04:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:03:46.547940 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ceb36-7239-4d89-a504-ba2a56f19e94 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:46.578704 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:46.662144 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ceb36-7239-4d89-a504-ba2a56f19e94 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:46.701375 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f810d7b-e575-4275-9bb5-55379062440c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:46.702048 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f810d7b-e575-4275-9bb5-55379062440c None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:46.702330 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f810d7b-e575-4275-9bb5-55379062440c None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:46.702616 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f810d7b-e575-4275-9bb5-55379062440c None admin] PATH_INFO: `/v3/users/placement` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:46.711623 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f810d7b-e575-4275-9bb5-55379062440c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:46.713090 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f810d7b-e575-4275-9bb5-55379062440c None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:46.724748 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-2f810d7b-e575-4275-9bb5-55379062440c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:03:46.724748 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:03:46.724748 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:03:46.724748 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:03:46.724748 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:03:46.724748 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:03:46.724748 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:03:46.724748 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:03:46.724748 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:03:46.724748 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:03:46.724748 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:03:46.724748 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:03:46.724748 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:03:46.724748 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:03:46.724748 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:03:46.724748 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:03:46.726265 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:03:46.726265 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:03:46.726265 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:03:46.726265 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:03:46.726265 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:03:46.726265 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:03:46.726265 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:03:46.726265 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:03:46.726265 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:03:46.726265 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:03:46.726265 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:03:46.726265 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:03:46.726265 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:03:46.726265 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:03:46.726265 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:03:46.726265 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:03:46.726265 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:03:46.726265 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:03:46.727752 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:03:46.727752 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:03:46.727752 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:03:46.727752 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:03:46.727752 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:03:46.727752 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:03:46.727752 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:03:46.727752 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:03:46.727752 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:03:46.727752 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:03:46.727752 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 461/901] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:03:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:03:46.732279 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b5532a-854d-4b41-92f4-8a3087ce7fa2 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:46.736475 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:46.839186 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b5532a-854d-4b41-92f4-8a3087ce7fa2 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:46.876728 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47008996-767b-4a77-b6ef-436dd9c20b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:46.877332 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47008996-767b-4a77-b6ef-436dd9c20b23 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:46.877608 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47008996-767b-4a77-b6ef-436dd9c20b23 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:46.877870 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47008996-767b-4a77-b6ef-436dd9c20b23 None admin] PATH_INFO: `/v3/users` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:46.878607 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47008996-767b-4a77-b6ef-436dd9c20b23 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:03:46.878904 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47008996-767b-4a77-b6ef-436dd9c20b23 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:46.880403 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47008996-767b-4a77-b6ef-436dd9c20b23 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:46.901100 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 441/902] 10.222.0.15 () {56 vars in 1143 bytes} [Wed Aug 24 04:03:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:03:46.907595 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f810d7b-e575-4275-9bb5-55379062440c None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:47.015091 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:47.031528 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f810d7b-e575-4275-9bb5-55379062440c None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:47.068155 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca24bd3-3f45-4783-a45a-359d4ea54b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:47.068762 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca24bd3-3f45-4783-a45a-359d4ea54b56 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:47.069042 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca24bd3-3f45-4783-a45a-359d4ea54b56 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:47.069316 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca24bd3-3f45-4783-a45a-359d4ea54b56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:47.143095 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca24bd3-3f45-4783-a45a-359d4ea54b56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:47.144595 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca24bd3-3f45-4783-a45a-359d4ea54b56 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:47.231313 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:47.248364 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 462/903] 10.222.0.15 () {58 vars in 1282 bytes} [Wed Aug 24 04:03:46 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:03:47.254767 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47008996-767b-4a77-b6ef-436dd9c20b23 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:47.317281 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:47.356223 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47008996-767b-4a77-b6ef-436dd9c20b23 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:47.390675 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941349e-a33e-416e-b2a5-cc4cff66688e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:47.391416 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941349e-a33e-416e-b2a5-cc4cff66688e None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:47.391623 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941349e-a33e-416e-b2a5-cc4cff66688e None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:47.391896 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941349e-a33e-416e-b2a5-cc4cff66688e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:47.402481 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a941349e-a33e-416e-b2a5-cc4cff66688e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:47.404105 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a941349e-a33e-416e-b2a5-cc4cff66688e None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:47.418895 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-a941349e-a33e-416e-b2a5-cc4cff66688e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:03:47.418895 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:03:47.418895 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:03:47.418895 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:03:47.418895 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:03:47.418895 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:03:47.418895 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:03:47.418895 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:03:47.418895 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:03:47.418895 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:03:47.418895 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:03:47.418895 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:03:47.418895 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:03:47.418895 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:03:47.418895 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:03:47.418895 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:03:47.420079 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:03:47.420079 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:03:47.420079 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:03:47.420079 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:03:47.420079 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:03:47.420079 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:03:47.420079 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:03:47.420079 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:03:47.420079 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:03:47.420079 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:03:47.420079 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:03:47.420079 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:03:47.420079 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:03:47.420079 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:03:47.420079 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:03:47.420079 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:03:47.420079 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:03:47.421101 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:03:47.421101 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:03:47.421101 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:03:47.421101 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 442/904] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:03:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:03:47.426259 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca24bd3-3f45-4783-a45a-359d4ea54b56 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:47.532676 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca24bd3-3f45-4783-a45a-359d4ea54b56 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:47.569843 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21afabf-13c4-4297-a67c-140de7261c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:47.570251 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21afabf-13c4-4297-a67c-140de7261c90 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:47.570528 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21afabf-13c4-4297-a67c-140de7261c90 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:47.570794 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21afabf-13c4-4297-a67c-140de7261c90 None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:47.571455 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21afabf-13c4-4297-a67c-140de7261c90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:03:47.572096 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21afabf-13c4-4297-a67c-140de7261c90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:47.573127 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21afabf-13c4-4297-a67c-140de7261c90 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:47.584806 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 463/905] 10.222.0.15 () {56 vars in 1109 bytes} [Wed Aug 24 04:03:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:03:47.591228 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941349e-a33e-416e-b2a5-cc4cff66688e None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:47.710341 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941349e-a33e-416e-b2a5-cc4cff66688e None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:47.725644 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:47.749434 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1eefd-ac65-4467-9e7f-756e6a387698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:47.750056 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1eefd-ac65-4467-9e7f-756e6a387698 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:47.750334 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1eefd-ac65-4467-9e7f-756e6a387698 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:47.750633 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1eefd-ac65-4467-9e7f-756e6a387698 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:47.757794 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c1eefd-ac65-4467-9e7f-756e6a387698 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:47.759290 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c1eefd-ac65-4467-9e7f-756e6a387698 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:47.771574 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-58c1eefd-ac65-4467-9e7f-756e6a387698 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:03:47.771574 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:03:47.771574 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:03:47.771574 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:03:47.771574 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:03:47.771574 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:03:47.771574 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:03:47.771574 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:03:47.771574 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:03:47.771574 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:03:47.771574 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:03:47.771574 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:03:47.771574 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:03:47.771574 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:03:47.771574 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:03:47.772612 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:03:47.772612 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:03:47.772612 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:03:47.772612 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:03:47.772612 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:03:47.772612 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:03:47.772612 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:03:47.772612 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:03:47.772612 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 24 04:03:47.772612 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:03:47.772612 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:03:47.772612 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:03:47.772612 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:03:47.772612 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:03:47.772612 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:03:47.772612 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:03:47.772612 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:03:47.773552 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:03:47.773552 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:03:47.773552 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:03:47.773552 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:03:47.773552 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:03:47.773552 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:03:47.773552 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:03:47.773552 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 24 04:03:47.773552 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 443/906] 10.222.0.15 () {56 vars in 1111 bytes} [Wed Aug 24 04:03:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:03:47.779070 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21afabf-13c4-4297-a67c-140de7261c90 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:47.829836 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:47.896314 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21afabf-13c4-4297-a67c-140de7261c90 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:47.932838 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8507ac-506c-47e4-b785-24366b04d66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:47.933436 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8507ac-506c-47e4-b785-24366b04d66b None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:47.933721 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8507ac-506c-47e4-b785-24366b04d66b None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:47.933996 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8507ac-506c-47e4-b785-24366b04d66b None admin] PATH_INFO: `/v3/projects` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:47.934684 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8507ac-506c-47e4-b785-24366b04d66b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:03:47.934994 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8507ac-506c-47e4-b785-24366b04d66b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:47.936468 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8507ac-506c-47e4-b785-24366b04d66b None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:47.949371 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 464/907] 10.222.0.15 () {56 vars in 1148 bytes} [Wed Aug 24 04:03:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:03:47.956878 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1eefd-ac65-4467-9e7f-756e6a387698 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:48.075463 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1eefd-ac65-4467-9e7f-756e6a387698 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:48.112591 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bfa3b4-aa04-40a4-a74a-3848dd5776ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:48.113121 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfa3b4-aa04-40a4-a74a-3848dd5776ab None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:48.113391 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfa3b4-aa04-40a4-a74a-3848dd5776ab None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:48.113662 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfa3b4-aa04-40a4-a74a-3848dd5776ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:48.114386 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bfa3b4-aa04-40a4-a74a-3848dd5776ab None admin] RBAC: Adding query filter params (role.id=df6a8bb215d54f71a0b6988a9c01f5e4, scope.project.id=5c317b3ce1d1468f95bc01ba2587e623, user.id=a3f34384ad354405a69b3cfa242e9504) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:03:48.114693 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bfa3b4-aa04-40a4-a74a-3848dd5776ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:48.116293 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bfa3b4-aa04-40a4-a74a-3848dd5776ab None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:48.122481 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 444/908] 10.222.0.15 () {56 vars in 1374 bytes} [Wed Aug 24 04:03:47 2022] GET /identity/v3/role_assignments?user.id=a3f34384ad354405a69b3cfa242e9504&scope.project.id=5c317b3ce1d1468f95bc01ba2587e623&role.id=df6a8bb215d54f71a0b6988a9c01f5e4 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:03:50.307518 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70e170-aa07-4a0c-98e4-c7c9872d43f2 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:50.308069 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70e170-aa07-4a0c-98e4-c7c9872d43f2 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:50.308069 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70e170-aa07-4a0c-98e4-c7c9872d43f2 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:50.309226 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 465/909] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:03:50.314921 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005e138-922e-4fe7-9298-72eb0870be9e None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:50.315431 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005e138-922e-4fe7-9298-72eb0870be9e None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:50.315543 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005e138-922e-4fe7-9298-72eb0870be9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:50.335417 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-7005e138-922e-4fe7-9298-72eb0870be9e None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:03:50.336634 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-7005e138-922e-4fe7-9298-72eb0870be9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:03:50.370325 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:50.431978 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 445/910] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:03:50 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:03:50.770768 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a70e170-aa07-4a0c-98e4-c7c9872d43f2 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:50.884358 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a70e170-aa07-4a0c-98e4-c7c9872d43f2 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:50.892619 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:50.929782 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea04909d-a353-4bf1-b92e-dab5e7261c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:50.930423 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04909d-a353-4bf1-b92e-dab5e7261c4c None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:50.930699 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04909d-a353-4bf1-b92e-dab5e7261c4c None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:50.930969 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04909d-a353-4bf1-b92e-dab5e7261c4c None admin] PATH_INFO: `/v3/services/placement` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:50.931599 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea04909d-a353-4bf1-b92e-dab5e7261c4c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:50.932972 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea04909d-a353-4bf1-b92e-dab5e7261c4c None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:50.942725 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-ea04909d-a353-4bf1-b92e-dab5e7261c4c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 04:03:50.942725 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:03:50.942725 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:03:50.942725 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:03:50.942725 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:03:50.942725 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:03:50.942725 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:03:50.942725 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:03:50.942725 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 04:03:50.942725 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:03:50.942725 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:03:50.942725 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:03:50.942725 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:03:50.942725 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:03:50.942725 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:03:50.942725 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:03:50.942725 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:03:50.944001 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:03:50.944001 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:03:50.944001 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:03:50.944001 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:03:50.944001 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:03:50.944001 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:03:50.944001 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:03:50.944001 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:03:50.944001 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:03:50.944001 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:03:50.944001 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:03:50.944001 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:03:50.944001 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:03:50.944001 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:03:50.944001 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:03:50.944001 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:03:50.944844 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:03:50.944844 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:03:50.944844 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:03:50.944844 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:03:50.944844 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:03:50.944844 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:03:50.944844 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:03:50.944844 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:03:50.944844 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:03:50.944844 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:03:50.944844 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:03:50.944844 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:03:50.944844 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 04:03:50.944844 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:03:50.944844 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 466/911] 10.222.0.15 () {56 vars in 1117 bytes} [Wed Aug 24 04:03:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:03:50.950534 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005e138-922e-4fe7-9298-72eb0870be9e None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:51.061916 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005e138-922e-4fe7-9298-72eb0870be9e None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:51.097587 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c7a0cb-5644-4bc3-90e4-3ccf85b66a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:51.098184 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7a0cb-5644-4bc3-90e4-3ccf85b66a88 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:51.098455 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7a0cb-5644-4bc3-90e4-3ccf85b66a88 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:51.098729 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7a0cb-5644-4bc3-90e4-3ccf85b66a88 None admin] PATH_INFO: `/v3/services` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:51.099400 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c7a0cb-5644-4bc3-90e4-3ccf85b66a88 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:03:51.099662 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c7a0cb-5644-4bc3-90e4-3ccf85b66a88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:51.101052 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c7a0cb-5644-4bc3-90e4-3ccf85b66a88 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:51.106024 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 446/912] 10.222.0.15 () {56 vars in 1116 bytes} [Wed Aug 24 04:03:50 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:03:51.112467 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea04909d-a353-4bf1-b92e-dab5e7261c4c None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:51.222593 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea04909d-a353-4bf1-b92e-dab5e7261c4c None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:51.258393 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ef926e-0f6a-43e8-b026-83f08f716c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:51.259069 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef926e-0f6a-43e8-b026-83f08f716c31 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:51.259388 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef926e-0f6a-43e8-b026-83f08f716c31 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:51.259687 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ef926e-0f6a-43e8-b026-83f08f716c31 None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:51.260349 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ef926e-0f6a-43e8-b026-83f08f716c31 None admin] RBAC: Adding query filter params (type=placement) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:03:51.260653 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ef926e-0f6a-43e8-b026-83f08f716c31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:51.262060 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ef926e-0f6a-43e8-b026-83f08f716c31 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:51.267074 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 467/913] 10.222.0.15 () {56 vars in 1116 bytes} [Wed Aug 24 04:03:51 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:03:53.472567 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547a46a-82b7-4867-b7c6-8d7d00cb6e07 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:53.473128 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547a46a-82b7-4867-b7c6-8d7d00cb6e07 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:53.473128 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547a46a-82b7-4867-b7c6-8d7d00cb6e07 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:53.474524 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 447/914] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:03:53.480663 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca27b62-4935-4e03-a4a3-ef432fed8dcb None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:53.481178 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca27b62-4935-4e03-a4a3-ef432fed8dcb None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:53.481337 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca27b62-4935-4e03-a4a3-ef432fed8dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:53.500952 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-2ca27b62-4935-4e03-a4a3-ef432fed8dcb None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:03:53.502175 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-2ca27b62-4935-4e03-a4a3-ef432fed8dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:03:53.531925 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:53.574664 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 468/915] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:03:53 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:03:53.905259 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c547a46a-82b7-4867-b7c6-8d7d00cb6e07 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:53.939069 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:54.018070 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c547a46a-82b7-4867-b7c6-8d7d00cb6e07 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:54.061604 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b818e27-aa07-40ad-9dc9-17edddc14f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:54.062347 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b818e27-aa07-40ad-9dc9-17edddc14f71 None admin] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:54.062645 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b818e27-aa07-40ad-9dc9-17edddc14f71 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:54.062971 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b818e27-aa07-40ad-9dc9-17edddc14f71 None admin] PATH_INFO: `/v3/services` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:54.063684 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b818e27-aa07-40ad-9dc9-17edddc14f71 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:54.065074 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b818e27-aa07-40ad-9dc9-17edddc14f71 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:54.086471 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 448/916] 10.222.0.15 () {60 vars in 1141 bytes} [Wed Aug 24 04:03:53 2022] POST /identity/v3/services => generated 246 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:03:56.338424 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7171a0a-ee8d-43d6-8e5b-ee47628ca79d None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:56.339004 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7171a0a-ee8d-43d6-8e5b-ee47628ca79d None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:56.339004 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7171a0a-ee8d-43d6-8e5b-ee47628ca79d None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:56.340420 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 469/917] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:03:56.346811 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7185bee-c91c-49ba-af0d-b64697542dad None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:56.347515 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7185bee-c91c-49ba-af0d-b64697542dad None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:56.347515 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7185bee-c91c-49ba-af0d-b64697542dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:56.369172 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-a7185bee-c91c-49ba-af0d-b64697542dad None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:03:56.370733 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-a7185bee-c91c-49ba-af0d-b64697542dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:03:56.464603 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 449/918] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:03:56 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:03:56.840893 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7171a0a-ee8d-43d6-8e5b-ee47628ca79d None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:56.964994 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7171a0a-ee8d-43d6-8e5b-ee47628ca79d None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:57.002926 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26002836-c79a-4c3e-ab47-ce52e6dd7c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:57.003639 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26002836-c79a-4c3e-ab47-ce52e6dd7c18 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:57.003851 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26002836-c79a-4c3e-ab47-ce52e6dd7c18 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:57.004117 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26002836-c79a-4c3e-ab47-ce52e6dd7c18 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:57.004707 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26002836-c79a-4c3e-ab47-ce52e6dd7c18 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:57.006082 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26002836-c79a-4c3e-ab47-ce52e6dd7c18 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:57.015141 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-26002836-c79a-4c3e-ab47-ce52e6dd7c18 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 04:03:57.015141 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:03:57.015141 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:03:57.015141 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:03:57.015141 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:03:57.015141 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:03:57.015141 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:03:57.015141 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:03:57.015141 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 04:03:57.015141 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:03:57.015141 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:03:57.015141 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:03:57.015141 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:03:57.015141 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:03:57.015141 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:03:57.015141 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:03:57.015141 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:03:57.016429 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:03:57.016429 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:03:57.016429 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:03:57.016429 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:03:57.016429 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:03:57.016429 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:03:57.016429 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:03:57.016429 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:03:57.016429 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:03:57.016429 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:03:57.016429 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:03:57.016429 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:03:57.016429 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:03:57.016429 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:03:57.016429 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:03:57.016429 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:03:57.017297 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:03:57.017297 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:03:57.017297 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:03:57.017297 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:03:57.017297 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:03:57.017297 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:03:57.017297 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:03:57.017297 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:03:57.017297 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:03:57.017297 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:03:57.017297 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:03:57.017297 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:03:57.017297 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 04:03:57.017297 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:03:57.017297 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 470/919] 10.222.0.15 () {56 vars in 1117 bytes} [Wed Aug 24 04:03:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:03:57.022887 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7185bee-c91c-49ba-af0d-b64697542dad None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:57.045023 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:57.140588 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7185bee-c91c-49ba-af0d-b64697542dad None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:57.179312 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b063d-c85b-45ce-86df-e61291855100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:57.179934 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b063d-c85b-45ce-86df-e61291855100 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:57.180206 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b063d-c85b-45ce-86df-e61291855100 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:57.180474 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b063d-c85b-45ce-86df-e61291855100 None admin] PATH_INFO: `/v3/services` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:57.181121 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b063d-c85b-45ce-86df-e61291855100 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:03:57.181420 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b063d-c85b-45ce-86df-e61291855100 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:57.182809 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b063d-c85b-45ce-86df-e61291855100 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:57.190021 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 450/920] 10.222.0.15 () {56 vars in 1116 bytes} [Wed Aug 24 04:03:57 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:03:57.196472 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26002836-c79a-4c3e-ab47-ce52e6dd7c18 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:57.227436 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:57.304761 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26002836-c79a-4c3e-ab47-ce52e6dd7c18 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:57.339819 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b349c6-2946-4f21-a45c-3de926b7a876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:57.340560 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b349c6-2946-4f21-a45c-3de926b7a876 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:57.340720 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b349c6-2946-4f21-a45c-3de926b7a876 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:57.340985 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b349c6-2946-4f21-a45c-3de926b7a876 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:57.341687 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b349c6-2946-4f21-a45c-3de926b7a876 None admin] RBAC: Adding query filter params (interface=public, service_id=d0e4df8649094b4f85d14f469034e0d1, region_id=RegionOne) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:03:57.341993 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b349c6-2946-4f21-a45c-3de926b7a876 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:57.343435 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b349c6-2946-4f21-a45c-3de926b7a876 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:57.349309 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 471/921] 10.222.0.15 () {56 vars in 1251 bytes} [Wed Aug 24 04:03:57 2022] GET /identity/v3/endpoints?service_id=d0e4df8649094b4f85d14f469034e0d1&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:03:57.355398 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b063d-c85b-45ce-86df-e61291855100 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:57.452288 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:57.472919 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b063d-c85b-45ce-86df-e61291855100 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:57.508363 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156153d8-2fd5-4b91-a379-985ab5ad7bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:57.508974 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156153d8-2fd5-4b91-a379-985ab5ad7bc7 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:57.509283 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156153d8-2fd5-4b91-a379-985ab5ad7bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:57.509565 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156153d8-2fd5-4b91-a379-985ab5ad7bc7 None admin] PATH_INFO: `/v3/services` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:57.510221 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156153d8-2fd5-4b91-a379-985ab5ad7bc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:57.511578 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156153d8-2fd5-4b91-a379-985ab5ad7bc7 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:57.518458 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 451/922] 10.222.0.15 () {56 vars in 1087 bytes} [Wed Aug 24 04:03:57 2022] GET /identity/v3/services => generated 1962 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:03:59.795967 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3558589-0ede-4572-9fa5-852b71d2e524 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:59.796558 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3558589-0ede-4572-9fa5-852b71d2e524 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:59.796855 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3558589-0ede-4572-9fa5-852b71d2e524 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:59.798963 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 472/923] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:03:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:03:59.805137 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bd480-ddac-439b-8880-0a38b3cb7365 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:59.805672 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bd480-ddac-439b-8880-0a38b3cb7365 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:59.805762 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bd480-ddac-439b-8880-0a38b3cb7365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:59.824897 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-993bd480-ddac-439b-8880-0a38b3cb7365 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:03:59.826084 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-993bd480-ddac-439b-8880-0a38b3cb7365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:03:59.904134 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 452/924] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:03:59 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:04:00.223089 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3558589-0ede-4572-9fa5-852b71d2e524 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:04:00.322505 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:04:00.334838 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3558589-0ede-4572-9fa5-852b71d2e524 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:04:00.371730 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123a036-f6c4-4885-9a9a-aa8038cf04bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:04:00.372350 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123a036-f6c4-4885-9a9a-aa8038cf04bc None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:04:00.372597 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123a036-f6c4-4885-9a9a-aa8038cf04bc None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:04:00.372884 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123a036-f6c4-4885-9a9a-aa8038cf04bc None admin] PATH_INFO: `/v3/services/placement` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:04:00.373468 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b123a036-f6c4-4885-9a9a-aa8038cf04bc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:04:00.374812 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b123a036-f6c4-4885-9a9a-aa8038cf04bc None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:04:00.384116 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-b123a036-f6c4-4885-9a9a-aa8038cf04bc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 04:04:00.384116 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:04:00.384116 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:04:00.384116 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:04:00.384116 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:04:00.384116 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:04:00.384116 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:04:00.384116 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:04:00.384116 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 04:04:00.384116 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:04:00.384116 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:04:00.384116 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:04:00.384116 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:04:00.384116 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:04:00.384116 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:04:00.384116 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:04:00.384116 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:04:00.385270 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:04:00.385270 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:04:00.385270 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:04:00.385270 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:04:00.385270 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:04:00.385270 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:04:00.385270 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:04:00.385270 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:04:00.385270 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:04:00.385270 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:04:00.385270 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:04:00.385270 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:04:00.385270 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:04:00.385270 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:04:00.385270 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:04:00.385270 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:04:00.386322 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:04:00.386322 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 24 04:04:00.386322 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:04:00.386322 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:04:00.386322 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:04:00.386322 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:04:00.386322 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:04:00.386322 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:04:00.386322 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:04:00.386322 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:04:00.386322 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:04:00.386322 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:04:00.386322 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 04:04:00.386322 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 24 04:04:00.386322 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 473/925] 10.222.0.15 () {56 vars in 1117 bytes} [Wed Aug 24 04:04:00 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:04:00.391381 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993bd480-ddac-439b-8880-0a38b3cb7365 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:04:00.472904 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:04:00.497001 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993bd480-ddac-439b-8880-0a38b3cb7365 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:04:00.532935 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10716c-5daf-42ee-8e41-d29e8b6ec73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:04:00.533540 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10716c-5daf-42ee-8e41-d29e8b6ec73d None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:04:00.533812 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10716c-5daf-42ee-8e41-d29e8b6ec73d None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:04:00.534079 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10716c-5daf-42ee-8e41-d29e8b6ec73d None admin] PATH_INFO: `/v3/services` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:04:00.534743 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10716c-5daf-42ee-8e41-d29e8b6ec73d None admin] RBAC: Adding query filter params (name=placement) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:04:00.535039 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10716c-5daf-42ee-8e41-d29e8b6ec73d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:04:00.536459 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10716c-5daf-42ee-8e41-d29e8b6ec73d None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:04:00.541601 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 453/926] 10.222.0.15 () {56 vars in 1116 bytes} [Wed Aug 24 04:04:00 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:04:00.547812 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123a036-f6c4-4885-9a9a-aa8038cf04bc None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:04:00.655903 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123a036-f6c4-4885-9a9a-aa8038cf04bc None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:04:00.691689 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f512b-dfcf-4ba4-94cb-1e4af35413ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:04:00.692291 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f512b-dfcf-4ba4-94cb-1e4af35413ba None admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:04:00.692570 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f512b-dfcf-4ba4-94cb-1e4af35413ba None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:04:00.692840 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f512b-dfcf-4ba4-94cb-1e4af35413ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:04:00.693506 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f512b-dfcf-4ba4-94cb-1e4af35413ba None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:04:00.694884 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f512b-dfcf-4ba4-94cb-1e4af35413ba None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:04:00.716163 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 474/927] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 24 04:04:00 2022] POST /identity/v3/endpoints => generated 331 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:04:10.538756 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=30 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:04:10.711706 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:05:08.355288 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44abaaa0-aa1a-422e-a321-7b0efb6ed11f None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:05:08.355909 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44abaaa0-aa1a-422e-a321-7b0efb6ed11f None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:05:08.355909 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44abaaa0-aa1a-422e-a321-7b0efb6ed11f None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:05:08.357377 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 454/928] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:05:08.363629 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33697bc3-f492-4fd7-9485-291f8778035b None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:05:08.364444 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33697bc3-f492-4fd7-9485-291f8778035b None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:05:08.364444 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33697bc3-f492-4fd7-9485-291f8778035b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:05:08.384776 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-33697bc3-f492-4fd7-9485-291f8778035b None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:05:08.386009 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-33697bc3-f492-4fd7-9485-291f8778035b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:05:08.559890 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 475/929] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:05:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:05:09.009187 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cedfc9-30dc-4792-b70f-d19b911e6cbc None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:05:09.009657 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cedfc9-30dc-4792-b70f-d19b911e6cbc None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:05:09.010120 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cedfc9-30dc-4792-b70f-d19b911e6cbc None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:05:09.013459 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 455/930] 10.222.0.15 () {54 vars in 965 bytes} [Wed Aug 24 04:05:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:05:09.020914 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc3f6e-1a81-4452-88d6-4213746d2006 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:05:09.021583 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc3f6e-1a81-4452-88d6-4213746d2006 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:05:09.022152 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc3f6e-1a81-4452-88d6-4213746d2006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:05:09.163941 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-bcbc3f6e-1a81-4452-88d6-4213746d2006 None None] MFA Rules not processed for user `e62f90d6440048e58cf530701a979e87`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:05:09.166055 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-bcbc3f6e-1a81-4452-88d6-4213746d2006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:05:09.255839 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 476/931] 10.222.0.15 () {58 vars in 1062 bytes} [Wed Aug 24 04:05:09 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:05:09.265868 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cedfc9-30dc-4792-b70f-d19b911e6cbc None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:05:09.283990 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cedfc9-30dc-4792-b70f-d19b911e6cbc None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:05:09.289994 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eeffa2-82a3-4f67-ac75-b8f5e3cbbe21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62f90d6440048e58cf530701a979e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:05:09.291003 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eeffa2-82a3-4f67-ac75-b8f5e3cbbe21 service neutron] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:05:09.291542 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eeffa2-82a3-4f67-ac75-b8f5e3cbbe21 service neutron] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:05:09.292032 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eeffa2-82a3-4f67-ac75-b8f5e3cbbe21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:05:09.307576 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eeffa2-82a3-4f67-ac75-b8f5e3cbbe21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:05:09.310084 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eeffa2-82a3-4f67-ac75-b8f5e3cbbe21 service neutron] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:05:09.327941 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 456/932] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:05:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:05:12.084379 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00bc0bc-d849-4ed8-bdab-a080e485805f None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:05:12.085131 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00bc0bc-d849-4ed8-bdab-a080e485805f None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:05:12.085131 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00bc0bc-d849-4ed8-bdab-a080e485805f None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:05:12.086497 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 477/933] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:05:12.092291 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11217bc-ef1a-48cf-ad6e-c3166b82c5dd None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:05:12.092876 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11217bc-ef1a-48cf-ad6e-c3166b82c5dd None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:05:12.092876 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11217bc-ef1a-48cf-ad6e-c3166b82c5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:05:12.114482 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-d11217bc-ef1a-48cf-ad6e-c3166b82c5dd None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:05:12.115774 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-d11217bc-ef1a-48cf-ad6e-c3166b82c5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:05:12.124275 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 457/934] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:05:12 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:05:12.468308 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00bc0bc-d849-4ed8-bdab-a080e485805f None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:05:12.487004 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00bc0bc-d849-4ed8-bdab-a080e485805f None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:05:12.491160 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3884f1-3764-4bcf-b442-e0ac708f6c46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62f90d6440048e58cf530701a979e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:05:12.491820 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3884f1-3764-4bcf-b442-e0ac708f6c46 service neutron] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:05:12.492099 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3884f1-3764-4bcf-b442-e0ac708f6c46 service neutron] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:05:12.492373 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3884f1-3764-4bcf-b442-e0ac708f6c46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:05:12.503600 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3884f1-3764-4bcf-b442-e0ac708f6c46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:05:12.505148 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3884f1-3764-4bcf-b442-e0ac708f6c46 service neutron] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:05:12.518012 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 478/935] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:05:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:05:15.201611 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc403bb4-89f7-4b93-91d4-0765e3a3e1cd None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:05:15.202189 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc403bb4-89f7-4b93-91d4-0765e3a3e1cd None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:05:15.202189 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc403bb4-89f7-4b93-91d4-0765e3a3e1cd None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:05:15.203531 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 458/936] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:05:15.209631 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edff5da-603f-45bb-87f6-014ea7e3ca5a None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:05:15.210232 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edff5da-603f-45bb-87f6-014ea7e3ca5a None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:05:15.210232 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edff5da-603f-45bb-87f6-014ea7e3ca5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:05:15.257398 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-3edff5da-603f-45bb-87f6-014ea7e3ca5a None None] MFA Rules not processed for user `fd730780576745e9955cd5f707848429`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:05:15.258679 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-3edff5da-603f-45bb-87f6-014ea7e3ca5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:05:15.305490 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:05:15.337844 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 479/937] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:05:15 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:05:15.702624 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01704af2-b87f-44f2-9a93-748e3a13ea3f None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:05:15.702890 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01704af2-b87f-44f2-9a93-748e3a13ea3f None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:05:15.703160 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01704af2-b87f-44f2-9a93-748e3a13ea3f None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:05:15.704570 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 459/938] 10.222.0.15 () {54 vars in 965 bytes} [Wed Aug 24 04:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:05:15.710764 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a6d0a-a2c8-47f7-ae79-78976b03d7d6 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:05:15.711183 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a6d0a-a2c8-47f7-ae79-78976b03d7d6 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:05:15.711616 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a6d0a-a2c8-47f7-ae79-78976b03d7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:05:15.732925 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-648a6d0a-a2c8-47f7-ae79-78976b03d7d6 None None] MFA Rules not processed for user `e62f90d6440048e58cf530701a979e87`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:05:15.734266 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-648a6d0a-a2c8-47f7-ae79-78976b03d7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:05:15.741696 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 480/939] 10.222.0.15 () {58 vars in 1062 bytes} [Wed Aug 24 04:05:15 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:05:15.751142 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01704af2-b87f-44f2-9a93-748e3a13ea3f None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:05:15.762909 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01704af2-b87f-44f2-9a93-748e3a13ea3f None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:05:15.767013 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288366b-4b07-41c8-a006-ef974e6e1b2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62f90d6440048e58cf530701a979e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:05:15.767665 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288366b-4b07-41c8-a006-ef974e6e1b2f service neutron] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:05:15.767940 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288366b-4b07-41c8-a006-ef974e6e1b2f service neutron] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:05:15.768208 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288366b-4b07-41c8-a006-ef974e6e1b2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:05:15.778939 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288366b-4b07-41c8-a006-ef974e6e1b2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:05:15.780462 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288366b-4b07-41c8-a006-ef974e6e1b2f service neutron] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:05:15.790635 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 460/940] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:05:15 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:05:18.932132 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72806ed8-1f60-4ed2-b9f6-11185f1051b7 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:05:18.932737 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72806ed8-1f60-4ed2-b9f6-11185f1051b7 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:05:18.933334 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72806ed8-1f60-4ed2-b9f6-11185f1051b7 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:05:18.935633 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 481/941] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:05:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:05:18.941570 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97198efe-c6f0-4cab-9295-11ca72f174a2 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:05:18.942406 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97198efe-c6f0-4cab-9295-11ca72f174a2 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:05:18.942406 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97198efe-c6f0-4cab-9295-11ca72f174a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:05:18.962121 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-97198efe-c6f0-4cab-9295-11ca72f174a2 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:05:18.964739 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-97198efe-c6f0-4cab-9295-11ca72f174a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:05:19.035997 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 461/942] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:05:18 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:05:19.371679 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72806ed8-1f60-4ed2-b9f6-11185f1051b7 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:05:19.383771 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72806ed8-1f60-4ed2-b9f6-11185f1051b7 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:05:19.388927 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2c417-c5d9-4ed7-b56c-6e3894be0a46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62f90d6440048e58cf530701a979e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:05:19.389940 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2c417-c5d9-4ed7-b56c-6e3894be0a46 service neutron] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:05:19.390429 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2c417-c5d9-4ed7-b56c-6e3894be0a46 service neutron] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:05:19.390886 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2c417-c5d9-4ed7-b56c-6e3894be0a46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:05:19.403602 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee2c417-c5d9-4ed7-b56c-6e3894be0a46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:05:19.405236 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee2c417-c5d9-4ed7-b56c-6e3894be0a46 service neutron] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:05:19.415564 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 482/943] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:05:19 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:05:22.278711 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847af75-ec2c-49dd-8fde-6f96b2363944 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:05:22.279337 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847af75-ec2c-49dd-8fde-6f96b2363944 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:05:22.279337 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847af75-ec2c-49dd-8fde-6f96b2363944 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:05:22.280715 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 462/944] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:05:22.286430 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6421a-6b88-4f99-951a-31719e0cc635 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:05:22.286930 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6421a-6b88-4f99-951a-31719e0cc635 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:05:22.287173 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6421a-6b88-4f99-951a-31719e0cc635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:05:22.313379 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-8ab6421a-6b88-4f99-951a-31719e0cc635 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:05:22.314639 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-8ab6421a-6b88-4f99-951a-31719e0cc635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:05:22.322831 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 483/945] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:05:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:05:22.653119 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847af75-ec2c-49dd-8fde-6f96b2363944 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:05:22.664394 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847af75-ec2c-49dd-8fde-6f96b2363944 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:05:22.667979 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a5deb-7b2c-4a5c-9a3b-8087c2dcc6f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62f90d6440048e58cf530701a979e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:05:22.668573 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a5deb-7b2c-4a5c-9a3b-8087c2dcc6f6 service neutron] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:05:22.668847 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a5deb-7b2c-4a5c-9a3b-8087c2dcc6f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:05:22.669111 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a5deb-7b2c-4a5c-9a3b-8087c2dcc6f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:05:22.683510 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557a5deb-7b2c-4a5c-9a3b-8087c2dcc6f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:05:22.684995 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557a5deb-7b2c-4a5c-9a3b-8087c2dcc6f6 service neutron] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:05:22.695597 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 463/946] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:05:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:05:24.931097 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055f228-a195-45d1-8dfd-4d91d04c8f35 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:05:24.931097 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055f228-a195-45d1-8dfd-4d91d04c8f35 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:05:24.931750 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055f228-a195-45d1-8dfd-4d91d04c8f35 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:05:24.933040 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 484/947] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:05:24.938578 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cd6d6-6981-4641-8bf3-4529e87ea43b None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:05:24.939079 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cd6d6-6981-4641-8bf3-4529e87ea43b None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:05:24.939079 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cd6d6-6981-4641-8bf3-4529e87ea43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:05:24.959173 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-053cd6d6-6981-4641-8bf3-4529e87ea43b None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:05:24.960407 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-053cd6d6-6981-4641-8bf3-4529e87ea43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:05:24.969085 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 464/948] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:05:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:05:25.314426 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055f228-a195-45d1-8dfd-4d91d04c8f35 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:05:25.325652 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055f228-a195-45d1-8dfd-4d91d04c8f35 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:05:25.329585 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ebbc2-d108-4010-b0e6-965e18235989 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62f90d6440048e58cf530701a979e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:05:25.330214 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ebbc2-d108-4010-b0e6-965e18235989 service neutron] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:05:25.330492 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ebbc2-d108-4010-b0e6-965e18235989 service neutron] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:05:25.330764 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ebbc2-d108-4010-b0e6-965e18235989 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:05:25.340617 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ebbc2-d108-4010-b0e6-965e18235989 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:05:25.342066 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ebbc2-d108-4010-b0e6-965e18235989 service neutron] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:05:25.352682 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 485/949] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:05:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:05:27.596805 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760ff3e-151c-492b-aa75-f0ba8d2412db None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:05:27.597361 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760ff3e-151c-492b-aa75-f0ba8d2412db None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:05:27.597361 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760ff3e-151c-492b-aa75-f0ba8d2412db None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:05:27.598682 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 465/950] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:05:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:05:27.604235 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748a1d0-a73b-4064-a968-b9f55064db4d None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:05:27.604703 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748a1d0-a73b-4064-a968-b9f55064db4d None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:05:27.604818 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748a1d0-a73b-4064-a968-b9f55064db4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:05:27.627458 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-b748a1d0-a73b-4064-a968-b9f55064db4d None None] MFA Rules not processed for user `fd730780576745e9955cd5f707848429`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:05:27.628678 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-b748a1d0-a73b-4064-a968-b9f55064db4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:05:27.636853 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 486/951] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:05:27 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:05:27.981489 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760ff3e-151c-492b-aa75-f0ba8d2412db None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:05:27.993047 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760ff3e-151c-492b-aa75-f0ba8d2412db None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:05:27.997017 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426137e-c24a-4276-98ef-f32ccc6fef25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62f90d6440048e58cf530701a979e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:05:27.997620 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426137e-c24a-4276-98ef-f32ccc6fef25 service neutron] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:05:27.997894 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426137e-c24a-4276-98ef-f32ccc6fef25 service neutron] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:05:27.998162 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426137e-c24a-4276-98ef-f32ccc6fef25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:05:28.008442 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426137e-c24a-4276-98ef-f32ccc6fef25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:05:28.009902 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426137e-c24a-4276-98ef-f32ccc6fef25 service neutron] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:05:28.021294 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 466/952] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:05:27 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:05:30.418937 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6c961-95e0-4c9f-928d-e0f18d4cdcef None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:05:30.419634 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6c961-95e0-4c9f-928d-e0f18d4cdcef None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:05:30.419634 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6c961-95e0-4c9f-928d-e0f18d4cdcef None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:05:30.420880 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 487/953] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:05:30.426457 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a7c1d-3a56-4dce-8239-85034064accc None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:05:30.426956 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a7c1d-3a56-4dce-8239-85034064accc None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:05:30.426956 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a7c1d-3a56-4dce-8239-85034064accc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:05:30.448178 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-ea8a7c1d-3a56-4dce-8239-85034064accc None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:05:30.450236 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-ea8a7c1d-3a56-4dce-8239-85034064accc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:05:30.463827 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 467/954] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:05:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:05:30.810082 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6c961-95e0-4c9f-928d-e0f18d4cdcef None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:05:30.821678 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6c961-95e0-4c9f-928d-e0f18d4cdcef None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:05:30.825396 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72431b53-421e-4c2e-a2bd-0afe158b9ee2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62f90d6440048e58cf530701a979e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:05:30.826002 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72431b53-421e-4c2e-a2bd-0afe158b9ee2 service neutron] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:05:30.826277 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72431b53-421e-4c2e-a2bd-0afe158b9ee2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:05:30.826544 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72431b53-421e-4c2e-a2bd-0afe158b9ee2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:05:30.836649 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72431b53-421e-4c2e-a2bd-0afe158b9ee2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:05:30.838081 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72431b53-421e-4c2e-a2bd-0afe158b9ee2 service neutron] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:05:30.848872 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 488/955] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:05:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:05:33.102472 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b88122-4921-495a-9333-f7e4a5b33d39 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:05:33.103065 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b88122-4921-495a-9333-f7e4a5b33d39 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:05:33.103065 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b88122-4921-495a-9333-f7e4a5b33d39 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:05:33.104402 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 468/956] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:05:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:05:33.110123 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e85d68-f07e-4f56-942d-e51a9927dce8 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:05:33.110655 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e85d68-f07e-4f56-942d-e51a9927dce8 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:05:33.110655 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e85d68-f07e-4f56-942d-e51a9927dce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:05:33.130602 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-03e85d68-f07e-4f56-942d-e51a9927dce8 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:05:33.131841 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-03e85d68-f07e-4f56-942d-e51a9927dce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:05:33.140401 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 489/957] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:05:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:05:33.480500 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b88122-4921-495a-9333-f7e4a5b33d39 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:05:33.486611 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=65 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:05:33.494151 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b88122-4921-495a-9333-f7e4a5b33d39 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:05:33.497936 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e71d21-8c46-4cec-b84b-08610b44338e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62f90d6440048e58cf530701a979e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:05:33.498636 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e71d21-8c46-4cec-b84b-08610b44338e service neutron] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:05:33.499467 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e71d21-8c46-4cec-b84b-08610b44338e service neutron] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:05:33.499467 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e71d21-8c46-4cec-b84b-08610b44338e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:05:33.509432 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e71d21-8c46-4cec-b84b-08610b44338e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:05:33.511865 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e71d21-8c46-4cec-b84b-08610b44338e service neutron] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:05:33.522943 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 469/958] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:05:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:05:36.132385 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce73fa-615d-4968-8d67-181eae8d1c3c None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:05:36.132991 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce73fa-615d-4968-8d67-181eae8d1c3c None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:05:36.132991 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce73fa-615d-4968-8d67-181eae8d1c3c None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:05:36.134297 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 490/959] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:05:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:05:36.139911 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd32d9-16e4-4469-b651-3bce8497e60a None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:05:36.140369 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd32d9-16e4-4469-b651-3bce8497e60a None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:05:36.140477 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd32d9-16e4-4469-b651-3bce8497e60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:05:36.164597 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-7cbd32d9-16e4-4469-b651-3bce8497e60a None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:05:36.167369 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-7cbd32d9-16e4-4469-b651-3bce8497e60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:05:36.182076 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 470/960] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:05:36 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:05:36.520422 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce73fa-615d-4968-8d67-181eae8d1c3c None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:05:36.533358 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce73fa-615d-4968-8d67-181eae8d1c3c None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:05:36.537637 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb67fd3-b932-4f54-b542-66196050d7f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62f90d6440048e58cf530701a979e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:05:36.538253 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb67fd3-b932-4f54-b542-66196050d7f1 service neutron] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:05:36.538530 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb67fd3-b932-4f54-b542-66196050d7f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:05:36.538802 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb67fd3-b932-4f54-b542-66196050d7f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:05:36.548565 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb67fd3-b932-4f54-b542-66196050d7f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:05:36.549999 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb67fd3-b932-4f54-b542-66196050d7f1 service neutron] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:05:36.559962 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 491/961] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:05:36 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:05:41.017861 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a9493-b65f-4183-834b-4215a9a74c81 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:05:41.018404 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a9493-b65f-4183-834b-4215a9a74c81 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:05:41.018404 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a9493-b65f-4183-834b-4215a9a74c81 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:05:41.019775 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 471/962] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:05:41.025699 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9b6e1-d70a-4495-8bd6-cdaf9d932f87 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:05:41.026392 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9b6e1-d70a-4495-8bd6-cdaf9d932f87 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:05:41.026392 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9b6e1-d70a-4495-8bd6-cdaf9d932f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:05:41.047070 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-b1d9b6e1-d70a-4495-8bd6-cdaf9d932f87 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:05:41.048339 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-b1d9b6e1-d70a-4495-8bd6-cdaf9d932f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:05:41.057126 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 492/963] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:05:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:05:41.423641 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a9493-b65f-4183-834b-4215a9a74c81 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:05:41.436237 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a9493-b65f-4183-834b-4215a9a74c81 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:05:41.440273 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefebbb1-9b16-4992-9b66-9eec26177feb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62f90d6440048e58cf530701a979e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:05:41.440877 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefebbb1-9b16-4992-9b66-9eec26177feb service neutron] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:05:41.441152 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefebbb1-9b16-4992-9b66-9eec26177feb service neutron] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:05:41.441416 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefebbb1-9b16-4992-9b66-9eec26177feb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:05:41.458219 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefebbb1-9b16-4992-9b66-9eec26177feb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:05:41.459983 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefebbb1-9b16-4992-9b66-9eec26177feb service neutron] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:05:41.470526 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 472/964] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:05:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:05:44.336200 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efc036-d214-43ea-9e01-70690904c8c7 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:05:44.336754 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efc036-d214-43ea-9e01-70690904c8c7 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:05:44.336754 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efc036-d214-43ea-9e01-70690904c8c7 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:05:44.338054 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 493/965] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:05:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:05:44.344275 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5b22b-5f45-45f1-bee8-64aab89424ef None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:05:44.344275 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5b22b-5f45-45f1-bee8-64aab89424ef None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:05:44.344275 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5b22b-5f45-45f1-bee8-64aab89424ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:05:44.366201 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-6ea5b22b-5f45-45f1-bee8-64aab89424ef None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:05:44.367450 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-6ea5b22b-5f45-45f1-bee8-64aab89424ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:05:44.376551 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 473/966] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:05:44 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:05:44.710171 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8efc036-d214-43ea-9e01-70690904c8c7 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:05:44.719031 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8efc036-d214-43ea-9e01-70690904c8c7 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:05:44.722827 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b732370-b053-4162-b53b-7dd967adff93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62f90d6440048e58cf530701a979e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:05:44.723493 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b732370-b053-4162-b53b-7dd967adff93 service neutron] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:05:44.723861 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b732370-b053-4162-b53b-7dd967adff93 service neutron] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:05:44.724135 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b732370-b053-4162-b53b-7dd967adff93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:05:44.733833 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b732370-b053-4162-b53b-7dd967adff93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:05:44.735298 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b732370-b053-4162-b53b-7dd967adff93 service neutron] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:05:44.745335 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 494/967] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:05:44 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:05:48.994527 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a489d-0396-4519-9c48-397433c643ab None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:05:48.995071 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a489d-0396-4519-9c48-397433c643ab None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:05:48.995071 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a489d-0396-4519-9c48-397433c643ab None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:05:48.996464 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 474/968] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:05:49.002492 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69b80a-b898-4eae-9321-bafd1c323872 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:05:49.003073 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69b80a-b898-4eae-9321-bafd1c323872 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:05:49.003073 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69b80a-b898-4eae-9321-bafd1c323872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:05:49.011453 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=57 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:05:49.025493 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-4a69b80a-b898-4eae-9321-bafd1c323872 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:05:49.026691 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-4a69b80a-b898-4eae-9321-bafd1c323872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:05:49.035350 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 495/969] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:05:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:05:49.370688 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a489d-0396-4519-9c48-397433c643ab None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:05:49.381585 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a489d-0396-4519-9c48-397433c643ab None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:05:49.385093 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a05476-b7d5-4d9c-88bd-7a04647bf28d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62f90d6440048e58cf530701a979e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:05:49.385685 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a05476-b7d5-4d9c-88bd-7a04647bf28d service neutron] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:05:49.385963 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a05476-b7d5-4d9c-88bd-7a04647bf28d service neutron] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:05:49.386233 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a05476-b7d5-4d9c-88bd-7a04647bf28d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:05:49.395260 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a05476-b7d5-4d9c-88bd-7a04647bf28d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:05:49.396735 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a05476-b7d5-4d9c-88bd-7a04647bf28d service neutron] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:05:49.406810 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 475/970] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:05:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:05:55.078649 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f9ea3-d5cc-4965-b8df-a737af6e630f None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:05:55.079571 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f9ea3-d5cc-4965-b8df-a737af6e630f None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:05:55.080017 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f9ea3-d5cc-4965-b8df-a737af6e630f None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:05:55.081802 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 496/971] 10.222.0.15 () {54 vars in 921 bytes} [Wed Aug 24 04:05:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:05:55.088689 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb46885-9d0e-4252-ad91-35b560054869 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:05:55.089607 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb46885-9d0e-4252-ad91-35b560054869 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:05:55.090534 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb46885-9d0e-4252-ad91-35b560054869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:05:55.158101 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-adb46885-9d0e-4252-ad91-35b560054869 None None] MFA Rules not processed for user `a3f34384ad354405a69b3cfa242e9504`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:05:55.159575 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-adb46885-9d0e-4252-ad91-35b560054869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:05:55.291663 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 476/972] 10.222.0.15 () {58 vars in 1018 bytes} [Wed Aug 24 04:05:55 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:05:59.020264 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=2 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:06:00.070274 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766150be-21de-4e33-95db-45ef0ffea720 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:00.070950 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766150be-21de-4e33-95db-45ef0ffea720 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:00.070950 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766150be-21de-4e33-95db-45ef0ffea720 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:00.072430 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 497/973] 10.222.0.15 () {54 vars in 921 bytes} [Wed Aug 24 04:06:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:06:00.078041 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2917a1e-181c-43e5-bc16-ff0128ccfa23 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:00.078556 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2917a1e-181c-43e5-bc16-ff0128ccfa23 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:00.078633 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2917a1e-181c-43e5-bc16-ff0128ccfa23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:00.101091 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-e2917a1e-181c-43e5-bc16-ff0128ccfa23 None None] MFA Rules not processed for user `a3f34384ad354405a69b3cfa242e9504`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:06:00.102435 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-e2917a1e-181c-43e5-bc16-ff0128ccfa23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:06:00.112542 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 477/974] 10.222.0.15 () {58 vars in 1018 bytes} [Wed Aug 24 04:06:00 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:06:01.705907 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b7029-3747-4c66-9ab6-dde4dc11bca3 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:01.706421 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b7029-3747-4c66-9ab6-dde4dc11bca3 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:01.706421 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b7029-3747-4c66-9ab6-dde4dc11bca3 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:01.707794 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 498/975] 10.222.0.15 () {54 vars in 921 bytes} [Wed Aug 24 04:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:06:01.713310 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45309e1e-4a17-461d-8dbf-37a5d2331bb9 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:01.713788 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45309e1e-4a17-461d-8dbf-37a5d2331bb9 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:01.713877 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45309e1e-4a17-461d-8dbf-37a5d2331bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:01.734655 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-45309e1e-4a17-461d-8dbf-37a5d2331bb9 None None] MFA Rules not processed for user `a3f34384ad354405a69b3cfa242e9504`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:06:01.735900 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-45309e1e-4a17-461d-8dbf-37a5d2331bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:06:01.745372 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 478/976] 10.222.0.15 () {58 vars in 1018 bytes} [Wed Aug 24 04:06:01 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:06:05.625153 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ac25e-8093-4357-92f5-64704ff7f8be None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:05.625673 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ac25e-8093-4357-92f5-64704ff7f8be None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:05.625673 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ac25e-8093-4357-92f5-64704ff7f8be None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:05.631887 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 499/977] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:06:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:06:05.633975 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794eee47-3dcc-40f2-81d4-715ddbb7610a None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:05.634977 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794eee47-3dcc-40f2-81d4-715ddbb7610a None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:05.635518 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794eee47-3dcc-40f2-81d4-715ddbb7610a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:05.644489 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=69 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:06:05.660047 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-794eee47-3dcc-40f2-81d4-715ddbb7610a None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:06:05.661623 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-794eee47-3dcc-40f2-81d4-715ddbb7610a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:06:05.671206 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 479/978] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:06:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:06:06.061552 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ed725-773a-417a-928a-58faf673ddde None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:06.062009 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ed725-773a-417a-928a-58faf673ddde None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:06.062391 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ed725-773a-417a-928a-58faf673ddde None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:06.063977 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 500/979] 10.222.0.15 () {54 vars in 962 bytes} [Wed Aug 24 04:06:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:06:06.078180 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a74b4-4ef9-42b3-873f-5b7c041c8644 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:06.078441 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a74b4-4ef9-42b3-873f-5b7c041c8644 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:06.078898 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a74b4-4ef9-42b3-873f-5b7c041c8644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:06.125959 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-b14a74b4-4ef9-42b3-873f-5b7c041c8644 None None] MFA Rules not processed for user `3796b1549762419686cb3b00af1a963e`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:06:06.127737 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-b14a74b4-4ef9-42b3-873f-5b7c041c8644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:06:06.222780 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 480/980] 10.222.0.15 () {58 vars in 1059 bytes} [Wed Aug 24 04:06:06 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:06:06.230617 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ed725-773a-417a-928a-58faf673ddde None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:06:06.245635 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ed725-773a-417a-928a-58faf673ddde None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:06:06.251861 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc47a8-8a97-49a8-8c72-ba60479304bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3796b1549762419686cb3b00af1a963e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:06:06.252701 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc47a8-8a97-49a8-8c72-ba60479304bc service nova] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:06.253081 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc47a8-8a97-49a8-8c72-ba60479304bc service nova] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:06.253512 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc47a8-8a97-49a8-8c72-ba60479304bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:06.264143 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcc47a8-8a97-49a8-8c72-ba60479304bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:06:06.265953 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcc47a8-8a97-49a8-8c72-ba60479304bc service nova] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:06:06.276648 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 501/981] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:06:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:06:08.700502 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035c161-4d35-4b7d-a175-f2f1c34d1c77 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:08.701023 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035c161-4d35-4b7d-a175-f2f1c34d1c77 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:08.701023 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035c161-4d35-4b7d-a175-f2f1c34d1c77 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:08.702665 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 481/982] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:06:08.707933 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd0d73-730b-4066-abf7-78c36d628ca3 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:08.708424 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd0d73-730b-4066-abf7-78c36d628ca3 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:08.708503 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd0d73-730b-4066-abf7-78c36d628ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:08.730591 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-d1bd0d73-730b-4066-abf7-78c36d628ca3 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:06:08.731806 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-d1bd0d73-730b-4066-abf7-78c36d628ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:06:08.739841 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 502/983] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:06:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:06:09.113283 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3035c161-4d35-4b7d-a175-f2f1c34d1c77 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:06:09.127800 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3035c161-4d35-4b7d-a175-f2f1c34d1c77 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:06:09.133434 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03176816-fb88-441e-ba70-8b4d6bfb2af1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3796b1549762419686cb3b00af1a963e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:06:09.134039 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03176816-fb88-441e-ba70-8b4d6bfb2af1 service nova] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:09.134313 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03176816-fb88-441e-ba70-8b4d6bfb2af1 service nova] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:09.134580 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03176816-fb88-441e-ba70-8b4d6bfb2af1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:09.143873 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03176816-fb88-441e-ba70-8b4d6bfb2af1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:06:09.145485 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03176816-fb88-441e-ba70-8b4d6bfb2af1 service nova] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:06:09.156247 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 482/984] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:06:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:06:11.772088 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a309dc3-4c37-49b6-bf2c-c8369a88f7c8 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:11.772642 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a309dc3-4c37-49b6-bf2c-c8369a88f7c8 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:11.772642 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a309dc3-4c37-49b6-bf2c-c8369a88f7c8 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:11.773950 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 503/985] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:06:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:06:11.779895 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c59b6-7728-4cb4-8441-e6712290e011 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:11.780445 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c59b6-7728-4cb4-8441-e6712290e011 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:11.780445 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c59b6-7728-4cb4-8441-e6712290e011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:11.800914 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-c47c59b6-7728-4cb4-8441-e6712290e011 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:06:11.802132 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-c47c59b6-7728-4cb4-8441-e6712290e011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:06:11.810506 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 483/986] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:06:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:06:12.170999 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ce829-051f-432f-8494-a37756bbf7df None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:12.171565 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ce829-051f-432f-8494-a37756bbf7df None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:12.171836 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ce829-051f-432f-8494-a37756bbf7df None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:12.174069 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 504/987] 10.222.0.15 () {54 vars in 962 bytes} [Wed Aug 24 04:06:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:06:12.179104 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461376fc-8f36-4401-977c-9b4509131cd9 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:12.179840 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461376fc-8f36-4401-977c-9b4509131cd9 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:12.180120 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461376fc-8f36-4401-977c-9b4509131cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:12.204144 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-461376fc-8f36-4401-977c-9b4509131cd9 None None] MFA Rules not processed for user `3796b1549762419686cb3b00af1a963e`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:06:12.205427 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-461376fc-8f36-4401-977c-9b4509131cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:06:12.214481 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 484/988] 10.222.0.15 () {58 vars in 1059 bytes} [Wed Aug 24 04:06:12 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:06:12.223787 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ce829-051f-432f-8494-a37756bbf7df None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:06:12.238073 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ce829-051f-432f-8494-a37756bbf7df None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:06:12.243367 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75717125-8736-450d-bc8a-6e8b63aefe57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3796b1549762419686cb3b00af1a963e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:06:12.244212 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75717125-8736-450d-bc8a-6e8b63aefe57 service nova] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:12.244643 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75717125-8736-450d-bc8a-6e8b63aefe57 service nova] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:12.245096 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75717125-8736-450d-bc8a-6e8b63aefe57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:12.254537 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75717125-8736-450d-bc8a-6e8b63aefe57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:06:12.257232 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75717125-8736-450d-bc8a-6e8b63aefe57 service nova] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:06:12.268130 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 505/989] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:06:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:06:14.653672 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489779c2-9d85-404f-a9c6-633cfe6dfe53 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:14.654756 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489779c2-9d85-404f-a9c6-633cfe6dfe53 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:14.655360 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489779c2-9d85-404f-a9c6-633cfe6dfe53 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:14.661340 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 485/990] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:06:14 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:06:14.662708 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b08ff-a766-4913-9946-2a58e15473c8 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:14.663166 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b08ff-a766-4913-9946-2a58e15473c8 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:14.663291 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b08ff-a766-4913-9946-2a58e15473c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:14.683157 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-ff4b08ff-a766-4913-9946-2a58e15473c8 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:06:14.684634 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-ff4b08ff-a766-4913-9946-2a58e15473c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:06:14.693444 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 506/991] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:06:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:06:15.042736 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489779c2-9d85-404f-a9c6-633cfe6dfe53 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:06:15.061267 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489779c2-9d85-404f-a9c6-633cfe6dfe53 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:06:15.074199 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e829a8-ad62-4da9-bf65-7a47f532cc06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3796b1549762419686cb3b00af1a963e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:06:15.079379 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e829a8-ad62-4da9-bf65-7a47f532cc06 service nova] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:15.080018 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e829a8-ad62-4da9-bf65-7a47f532cc06 service nova] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:15.080788 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e829a8-ad62-4da9-bf65-7a47f532cc06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:15.090883 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e829a8-ad62-4da9-bf65-7a47f532cc06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:06:15.092945 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e829a8-ad62-4da9-bf65-7a47f532cc06 service nova] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:06:15.118874 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 486/992] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:06:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:06:16.416319 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c2380-e0f1-41bb-ba52-95e976113f4f None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:16.416892 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c2380-e0f1-41bb-ba52-95e976113f4f None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:16.417346 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c2380-e0f1-41bb-ba52-95e976113f4f None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:16.418951 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 507/993] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:06:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:06:16.425008 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77acf6a9-031e-45d0-b338-d5cb7658a0c7 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:16.425503 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77acf6a9-031e-45d0-b338-d5cb7658a0c7 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:16.425617 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77acf6a9-031e-45d0-b338-d5cb7658a0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:16.448020 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-77acf6a9-031e-45d0-b338-d5cb7658a0c7 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:06:16.449569 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-77acf6a9-031e-45d0-b338-d5cb7658a0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:06:16.458954 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 487/994] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:06:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:06:17.023237 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ade2e-92d3-4df8-9a4b-40ea08a30ae1 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:17.023482 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ade2e-92d3-4df8-9a4b-40ea08a30ae1 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:17.023750 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ade2e-92d3-4df8-9a4b-40ea08a30ae1 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:17.025260 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 508/995] 10.222.0.15 () {54 vars in 964 bytes} [Wed Aug 24 04:06:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:06:17.030880 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe39a08-a879-4f29-ba65-78f945a52cf7 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:17.031389 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe39a08-a879-4f29-ba65-78f945a52cf7 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:17.031757 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe39a08-a879-4f29-ba65-78f945a52cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:17.077272 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-dbe39a08-a879-4f29-ba65-78f945a52cf7 None None] MFA Rules not processed for user `9d60ca48fd1b4a4ab4261ad1dbd6c8bc`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:06:17.078738 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-dbe39a08-a879-4f29-ba65-78f945a52cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:06:17.173063 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 488/996] 10.222.0.15 () {58 vars in 1061 bytes} [Wed Aug 24 04:06:17 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:06:17.180851 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ade2e-92d3-4df8-9a4b-40ea08a30ae1 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:06:17.193188 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ade2e-92d3-4df8-9a4b-40ea08a30ae1 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:06:17.197435 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1bf7d-9321-4f1a-8836-bf32dc3514cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d60ca48fd1b4a4ab4261ad1dbd6c8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:06:17.198220 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1bf7d-9321-4f1a-8836-bf32dc3514cb service cinder] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:17.198570 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1bf7d-9321-4f1a-8836-bf32dc3514cb service cinder] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:17.198915 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1bf7d-9321-4f1a-8836-bf32dc3514cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:17.209460 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f1bf7d-9321-4f1a-8836-bf32dc3514cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:06:17.210919 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f1bf7d-9321-4f1a-8836-bf32dc3514cb service cinder] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:06:17.221335 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 509/997] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:06:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:06:17.526920 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eced92b-3a30-4f3c-971c-a4178374855a None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:17.527516 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eced92b-3a30-4f3c-971c-a4178374855a None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:17.527516 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eced92b-3a30-4f3c-971c-a4178374855a None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:17.528803 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 489/998] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:06:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:06:17.534996 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2008a-0895-4e07-a32d-a4e0d68f6971 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:17.535586 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2008a-0895-4e07-a32d-a4e0d68f6971 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:17.535586 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2008a-0895-4e07-a32d-a4e0d68f6971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:17.556674 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-ceb2008a-0895-4e07-a32d-a4e0d68f6971 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:06:17.557935 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-ceb2008a-0895-4e07-a32d-a4e0d68f6971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:06:17.567759 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 510/999] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:06:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:06:17.918667 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eced92b-3a30-4f3c-971c-a4178374855a None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:06:17.944109 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eced92b-3a30-4f3c-971c-a4178374855a None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:06:17.952863 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae60f31-ce0c-4e47-bd35-5741bb7980ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3796b1549762419686cb3b00af1a963e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:06:17.953389 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae60f31-ce0c-4e47-bd35-5741bb7980ed service nova] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:17.953759 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae60f31-ce0c-4e47-bd35-5741bb7980ed service nova] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:17.953953 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae60f31-ce0c-4e47-bd35-5741bb7980ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:17.973975 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae60f31-ce0c-4e47-bd35-5741bb7980ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:06:17.976380 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae60f31-ce0c-4e47-bd35-5741bb7980ed service nova] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:06:17.982671 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:06:17.996626 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 490/1000] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:06:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:06:20.306927 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4298a8-c6d8-4082-90a8-af0841a7d2bc None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:20.307549 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4298a8-c6d8-4082-90a8-af0841a7d2bc None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:20.307549 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4298a8-c6d8-4082-90a8-af0841a7d2bc None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:20.308734 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 511/1001] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:06:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:06:20.315248 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70adb0fe-03ff-4b16-815b-744507297ca4 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:20.315707 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70adb0fe-03ff-4b16-815b-744507297ca4 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:20.315944 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70adb0fe-03ff-4b16-815b-744507297ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:20.337573 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-70adb0fe-03ff-4b16-815b-744507297ca4 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:06:20.338892 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-70adb0fe-03ff-4b16-815b-744507297ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:06:20.348123 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 491/1002] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:06:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:06:20.689749 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4298a8-c6d8-4082-90a8-af0841a7d2bc None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:06:20.704118 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4298a8-c6d8-4082-90a8-af0841a7d2bc None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:06:20.708997 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16f0892-03e7-48ee-a442-9374eac756da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3796b1549762419686cb3b00af1a963e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:06:20.709623 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f0892-03e7-48ee-a442-9374eac756da service nova] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:20.709893 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f0892-03e7-48ee-a442-9374eac756da service nova] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:20.710156 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f0892-03e7-48ee-a442-9374eac756da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:20.718606 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16f0892-03e7-48ee-a442-9374eac756da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:06:20.720215 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16f0892-03e7-48ee-a442-9374eac756da service nova] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:06:20.729527 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 512/1003] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:06:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:06:22.970491 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4674fad-b327-401f-8a0f-839afc1024d1 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:22.971125 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4674fad-b327-401f-8a0f-839afc1024d1 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:22.971125 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4674fad-b327-401f-8a0f-839afc1024d1 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:22.972987 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 492/1004] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:06:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:06:22.979599 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3475bd1-eef9-406e-926c-5142aa6bc5ba None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:22.980078 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3475bd1-eef9-406e-926c-5142aa6bc5ba None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:22.980334 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3475bd1-eef9-406e-926c-5142aa6bc5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:23.002162 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-b3475bd1-eef9-406e-926c-5142aa6bc5ba None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:06:23.003673 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-b3475bd1-eef9-406e-926c-5142aa6bc5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:06:23.012510 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 513/1005] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:06:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:06:23.372172 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4674fad-b327-401f-8a0f-839afc1024d1 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:06:23.386327 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4674fad-b327-401f-8a0f-839afc1024d1 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:06:23.391824 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7cb467-230a-4e70-89a7-eb3c8c3bbee5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3796b1549762419686cb3b00af1a963e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:06:23.392381 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7cb467-230a-4e70-89a7-eb3c8c3bbee5 service nova] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:23.392649 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7cb467-230a-4e70-89a7-eb3c8c3bbee5 service nova] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:23.392920 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7cb467-230a-4e70-89a7-eb3c8c3bbee5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:23.402404 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7cb467-230a-4e70-89a7-eb3c8c3bbee5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:06:23.404082 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7cb467-230a-4e70-89a7-eb3c8c3bbee5 service nova] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:06:23.415006 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 493/1006] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:06:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:06:25.834390 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93809422-faec-4b1b-b070-650785d4d891 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:25.834984 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93809422-faec-4b1b-b070-650785d4d891 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:25.835121 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93809422-faec-4b1b-b070-650785d4d891 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:25.837221 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 514/1007] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:06:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:06:25.844383 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49e204-8443-4b40-a747-ba88873577d8 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:25.844980 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49e204-8443-4b40-a747-ba88873577d8 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:25.844980 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49e204-8443-4b40-a747-ba88873577d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:25.866369 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-0d49e204-8443-4b40-a747-ba88873577d8 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:06:25.867625 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-0d49e204-8443-4b40-a747-ba88873577d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:06:25.877624 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 494/1008] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:06:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:06:26.225757 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93809422-faec-4b1b-b070-650785d4d891 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:06:26.239634 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93809422-faec-4b1b-b070-650785d4d891 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:06:26.244683 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1881d0-3fce-48a6-a1e3-a464e00a825c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3796b1549762419686cb3b00af1a963e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:06:26.245296 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1881d0-3fce-48a6-a1e3-a464e00a825c service nova] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:26.245579 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1881d0-3fce-48a6-a1e3-a464e00a825c service nova] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:26.245854 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1881d0-3fce-48a6-a1e3-a464e00a825c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:26.254521 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1881d0-3fce-48a6-a1e3-a464e00a825c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:06:26.256688 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1881d0-3fce-48a6-a1e3-a464e00a825c service nova] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:06:26.267950 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 515/1009] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:06:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:06:28.911899 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89386843-728b-4ef8-958f-9c31e7ce2779 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:28.912585 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89386843-728b-4ef8-958f-9c31e7ce2779 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:28.912585 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89386843-728b-4ef8-958f-9c31e7ce2779 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:28.913820 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 495/1010] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:06:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:06:28.919625 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b5420-b90e-45e2-abce-ced503889a00 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:28.920162 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b5420-b90e-45e2-abce-ced503889a00 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:28.920162 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b5420-b90e-45e2-abce-ced503889a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:28.950346 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-f29b5420-b90e-45e2-abce-ced503889a00 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:06:28.951592 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-f29b5420-b90e-45e2-abce-ced503889a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:06:28.962499 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 516/1011] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:06:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:06:29.321682 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89386843-728b-4ef8-958f-9c31e7ce2779 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:06:29.348226 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89386843-728b-4ef8-958f-9c31e7ce2779 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:06:29.354793 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb51fd-db38-4d5c-87e6-2c298d7a603d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3796b1549762419686cb3b00af1a963e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:06:29.355459 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb51fd-db38-4d5c-87e6-2c298d7a603d service nova] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:29.355772 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb51fd-db38-4d5c-87e6-2c298d7a603d service nova] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:29.356034 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb51fd-db38-4d5c-87e6-2c298d7a603d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:29.365530 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb51fd-db38-4d5c-87e6-2c298d7a603d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:06:29.367242 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb51fd-db38-4d5c-87e6-2c298d7a603d service nova] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:06:29.378072 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 496/1012] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:06:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:06:32.377400 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f87ddb-9960-484f-8229-ff632eba983a None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:32.378127 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f87ddb-9960-484f-8229-ff632eba983a None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:32.378127 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f87ddb-9960-484f-8229-ff632eba983a None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:32.379342 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 517/1013] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:06:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:06:32.384922 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ee2cd-2c62-4166-bc66-0398ae11f38c None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:32.385440 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ee2cd-2c62-4166-bc66-0398ae11f38c None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:32.385440 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ee2cd-2c62-4166-bc66-0398ae11f38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:32.405615 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-441ee2cd-2c62-4166-bc66-0398ae11f38c None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:06:32.406835 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-441ee2cd-2c62-4166-bc66-0398ae11f38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:06:32.416119 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 497/1014] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:06:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:06:32.763382 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f87ddb-9960-484f-8229-ff632eba983a None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:06:32.771873 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=46 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:06:32.779271 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f87ddb-9960-484f-8229-ff632eba983a None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:06:32.784517 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe32e1b-3f64-47c5-be2b-55ac91d747a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3796b1549762419686cb3b00af1a963e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:06:32.785116 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe32e1b-3f64-47c5-be2b-55ac91d747a2 service nova] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:32.785392 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe32e1b-3f64-47c5-be2b-55ac91d747a2 service nova] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:32.785659 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe32e1b-3f64-47c5-be2b-55ac91d747a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:32.794238 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe32e1b-3f64-47c5-be2b-55ac91d747a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:06:32.795879 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe32e1b-3f64-47c5-be2b-55ac91d747a2 service nova] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:06:32.805476 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 518/1015] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:06:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:06:33.707564 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96cb82-9b12-40f1-a299-6c92a6687870 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:33.708181 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96cb82-9b12-40f1-a299-6c92a6687870 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:33.708181 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96cb82-9b12-40f1-a299-6c92a6687870 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:33.709499 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 498/1016] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:06:33.715321 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fdb0f3-71f5-48ef-9689-1fd508c27054 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:33.715777 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fdb0f3-71f5-48ef-9689-1fd508c27054 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:33.715886 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fdb0f3-71f5-48ef-9689-1fd508c27054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:33.736297 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-c1fdb0f3-71f5-48ef-9689-1fd508c27054 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:06:33.737525 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-c1fdb0f3-71f5-48ef-9689-1fd508c27054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:06:33.746154 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 519/1017] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:06:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:06:34.099302 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a9af9-ed90-45a3-b95b-aa3df8ca3649 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:34.099543 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a9af9-ed90-45a3-b95b-aa3df8ca3649 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:34.099835 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a9af9-ed90-45a3-b95b-aa3df8ca3649 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:34.101188 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 499/1018] 10.222.0.15 () {54 vars in 967 bytes} [Wed Aug 24 04:06:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:06:34.106740 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89898f2a-86f5-477a-85ba-03064c5996f5 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:34.107043 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89898f2a-86f5-477a-85ba-03064c5996f5 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:34.107330 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89898f2a-86f5-477a-85ba-03064c5996f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:34.147590 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-89898f2a-86f5-477a-85ba-03064c5996f5 None None] MFA Rules not processed for user `7da73e8a2c7a4c5aafd1d3fbea603970`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:06:34.148884 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-89898f2a-86f5-477a-85ba-03064c5996f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:06:34.210406 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 520/1019] 10.222.0.15 () {58 vars in 1064 bytes} [Wed Aug 24 04:06:34 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:06:34.218094 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a9af9-ed90-45a3-b95b-aa3df8ca3649 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:06:34.230029 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a9af9-ed90-45a3-b95b-aa3df8ca3649 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:06:34.234273 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d683000d-b0b5-47eb-9e70-1ee6589b9ff9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7da73e8a2c7a4c5aafd1d3fbea603970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:06:34.234872 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683000d-b0b5-47eb-9e70-1ee6589b9ff9 service glance] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:34.235143 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683000d-b0b5-47eb-9e70-1ee6589b9ff9 service glance] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:34.235442 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683000d-b0b5-47eb-9e70-1ee6589b9ff9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:34.245390 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d683000d-b0b5-47eb-9e70-1ee6589b9ff9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:06:34.246838 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d683000d-b0b5-47eb-9e70-1ee6589b9ff9 service glance] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:06:34.256954 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 500/1020] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:06:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:06:35.022301 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2866ad1-e3e8-4961-a1a8-369966f0bac2 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:35.022944 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2866ad1-e3e8-4961-a1a8-369966f0bac2 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:35.022944 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2866ad1-e3e8-4961-a1a8-369966f0bac2 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:35.024119 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 521/1021] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:06:35.029764 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9126675-88d4-43d2-97ab-4058fa1e9be3 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:35.030326 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9126675-88d4-43d2-97ab-4058fa1e9be3 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:35.030326 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9126675-88d4-43d2-97ab-4058fa1e9be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:35.050210 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-c9126675-88d4-43d2-97ab-4058fa1e9be3 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:06:35.051430 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-c9126675-88d4-43d2-97ab-4058fa1e9be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:06:35.061732 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 501/1022] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:06:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:06:35.421996 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2866ad1-e3e8-4961-a1a8-369966f0bac2 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:06:35.441085 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2866ad1-e3e8-4961-a1a8-369966f0bac2 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:06:35.446832 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a31f7-af7f-47b2-9c13-d025764d006f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3796b1549762419686cb3b00af1a963e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:06:35.447486 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a31f7-af7f-47b2-9c13-d025764d006f service nova] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:35.447765 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a31f7-af7f-47b2-9c13-d025764d006f service nova] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:35.448035 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a31f7-af7f-47b2-9c13-d025764d006f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:35.459662 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92a31f7-af7f-47b2-9c13-d025764d006f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:06:35.461286 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92a31f7-af7f-47b2-9c13-d025764d006f service nova] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:06:35.473188 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 522/1023] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:06:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:06:37.788511 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c67137-5eec-43bf-9017-3da8b65cba59 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:37.789375 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c67137-5eec-43bf-9017-3da8b65cba59 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:37.789375 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c67137-5eec-43bf-9017-3da8b65cba59 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:37.790604 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 502/1024] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:06:37.796780 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfb140-7fb6-4012-adf5-31c0ff67e115 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:37.797354 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfb140-7fb6-4012-adf5-31c0ff67e115 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:37.797468 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfb140-7fb6-4012-adf5-31c0ff67e115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:37.818618 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-48dfb140-7fb6-4012-adf5-31c0ff67e115 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:06:37.819860 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-48dfb140-7fb6-4012-adf5-31c0ff67e115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:06:37.831573 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 523/1025] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:06:37 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:06:38.183418 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c67137-5eec-43bf-9017-3da8b65cba59 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:06:38.201159 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c67137-5eec-43bf-9017-3da8b65cba59 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:06:38.206670 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e04e3f-e998-4319-ab38-7333323f7536 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3796b1549762419686cb3b00af1a963e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:06:38.207335 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e04e3f-e998-4319-ab38-7333323f7536 service nova] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:38.207610 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e04e3f-e998-4319-ab38-7333323f7536 service nova] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:38.207876 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e04e3f-e998-4319-ab38-7333323f7536 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:38.217520 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e04e3f-e998-4319-ab38-7333323f7536 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:06:38.219134 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e04e3f-e998-4319-ab38-7333323f7536 service nova] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:06:38.232943 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 503/1026] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:06:38 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:06:47.813582 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=50 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:06:48.225334 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=37 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:06:49.770164 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ede72-65b8-48b4-969f-c1bac190b8d5 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:49.770842 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ede72-65b8-48b4-969f-c1bac190b8d5 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:49.770842 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ede72-65b8-48b4-969f-c1bac190b8d5 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:49.772051 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 524/1027] 10.222.0.15 () {54 vars in 918 bytes} [Wed Aug 24 04:06:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:06:49.777348 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c0810-2e2b-414a-ba6d-a8506585783f None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:49.777833 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c0810-2e2b-414a-ba6d-a8506585783f None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:49.777948 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c0810-2e2b-414a-ba6d-a8506585783f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:49.798215 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-a50c0810-2e2b-414a-ba6d-a8506585783f None None] MFA Rules not processed for user `a3f34384ad354405a69b3cfa242e9504`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:06:49.800028 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-a50c0810-2e2b-414a-ba6d-a8506585783f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:06:49.809150 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 504/1028] 10.222.0.15 () {58 vars in 1015 bytes} [Wed Aug 24 04:06:49 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:06:49.824213 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe97529-ccbb-4cf8-97f3-a9a0db293adb None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:49.824477 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe97529-ccbb-4cf8-97f3-a9a0db293adb None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:49.824771 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe97529-ccbb-4cf8-97f3-a9a0db293adb None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:49.826209 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 525/1029] 10.222.0.15 () {54 vars in 918 bytes} [Wed Aug 24 04:06:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:06:49.831175 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444a645-0f0d-4bd0-95c6-79ec5132525b None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:49.831491 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444a645-0f0d-4bd0-95c6-79ec5132525b None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:49.831757 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444a645-0f0d-4bd0-95c6-79ec5132525b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:49.852371 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-5444a645-0f0d-4bd0-95c6-79ec5132525b None None] MFA Rules not processed for user `3796b1549762419686cb3b00af1a963e`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:06:49.853577 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-5444a645-0f0d-4bd0-95c6-79ec5132525b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:06:49.863813 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 505/1030] 10.222.0.15 () {58 vars in 1015 bytes} [Wed Aug 24 04:06:49 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:06:52.576593 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe68afb-98a5-4b0c-8406-32021f494834 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:52.577775 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe68afb-98a5-4b0c-8406-32021f494834 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:52.578418 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe68afb-98a5-4b0c-8406-32021f494834 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:52.580943 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 526/1031] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:06:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:06:52.590494 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21acae27-6251-425a-b5c7-4e3bdfb22556 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:52.591066 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21acae27-6251-425a-b5c7-4e3bdfb22556 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:52.591624 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21acae27-6251-425a-b5c7-4e3bdfb22556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:52.620273 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-21acae27-6251-425a-b5c7-4e3bdfb22556 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:06:52.621472 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-21acae27-6251-425a-b5c7-4e3bdfb22556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:06:52.630761 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 506/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:06:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:06:52.969427 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe68afb-98a5-4b0c-8406-32021f494834 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:06:52.984856 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe68afb-98a5-4b0c-8406-32021f494834 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:06:52.990252 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46858d7-5767-452c-9634-c7e9dfb56df2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3796b1549762419686cb3b00af1a963e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:06:52.990845 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46858d7-5767-452c-9634-c7e9dfb56df2 service nova] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:52.991117 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46858d7-5767-452c-9634-c7e9dfb56df2 service nova] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:52.991415 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46858d7-5767-452c-9634-c7e9dfb56df2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:53.000340 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46858d7-5767-452c-9634-c7e9dfb56df2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:06:53.001930 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46858d7-5767-452c-9634-c7e9dfb56df2 service nova] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:06:53.011413 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 527/1033] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:06:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:06:53.991186 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc5e9f-9122-4ff1-b813-090409aed4ca None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:53.991808 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc5e9f-9122-4ff1-b813-090409aed4ca None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:53.991808 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc5e9f-9122-4ff1-b813-090409aed4ca None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:53.993006 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 507/1034] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:06:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:06:53.998324 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdf70a-d507-4ba9-ae5d-ef04b3cf3ff3 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:53.998780 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdf70a-d507-4ba9-ae5d-ef04b3cf3ff3 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:53.998892 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdf70a-d507-4ba9-ae5d-ef04b3cf3ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:54.019930 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-d5bdf70a-d507-4ba9-ae5d-ef04b3cf3ff3 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:06:54.021143 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-d5bdf70a-d507-4ba9-ae5d-ef04b3cf3ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:06:54.029912 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 528/1035] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:06:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:06:54.255157 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc5e9f-9122-4ff1-b813-090409aed4ca None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:06:54.270473 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc5e9f-9122-4ff1-b813-090409aed4ca None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:06:54.277042 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8fab81-998a-4c21-8044-1ec2b59204e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3796b1549762419686cb3b00af1a963e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:06:54.277644 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8fab81-998a-4c21-8044-1ec2b59204e9 service nova] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:54.277923 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8fab81-998a-4c21-8044-1ec2b59204e9 service nova] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:54.278199 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8fab81-998a-4c21-8044-1ec2b59204e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:54.287280 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8fab81-998a-4c21-8044-1ec2b59204e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:06:54.288944 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8fab81-998a-4c21-8044-1ec2b59204e9 service nova] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:06:54.299461 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 508/1036] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:06:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:06:55.216025 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf694a-64b0-42e7-87d2-25032fbcad8b None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:55.216588 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf694a-64b0-42e7-87d2-25032fbcad8b None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:55.216588 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf694a-64b0-42e7-87d2-25032fbcad8b None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:55.217827 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 529/1037] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:06:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:06:55.223221 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22ccda-32fb-456b-bb39-72be8759e505 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:55.223671 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22ccda-32fb-456b-bb39-72be8759e505 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:55.223787 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22ccda-32fb-456b-bb39-72be8759e505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:55.244193 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-af22ccda-32fb-456b-bb39-72be8759e505 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:06:55.245397 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-af22ccda-32fb-456b-bb39-72be8759e505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:06:55.254311 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 509/1038] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:06:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:06:55.409767 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf694a-64b0-42e7-87d2-25032fbcad8b None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:06:55.426111 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf694a-64b0-42e7-87d2-25032fbcad8b None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:06:55.431278 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0a0ac-12c2-42e7-a108-e77e47df67fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3796b1549762419686cb3b00af1a963e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:06:55.431877 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0a0ac-12c2-42e7-a108-e77e47df67fd service nova] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:55.432151 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0a0ac-12c2-42e7-a108-e77e47df67fd service nova] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:55.432419 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0a0ac-12c2-42e7-a108-e77e47df67fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:55.440768 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b0a0ac-12c2-42e7-a108-e77e47df67fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:06:55.442631 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b0a0ac-12c2-42e7-a108-e77e47df67fd service nova] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:06:55.452641 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 530/1039] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:06:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:06:56.321921 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fa64e-4542-472e-8ba8-63cab796a3b2 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:56.322486 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fa64e-4542-472e-8ba8-63cab796a3b2 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:56.322486 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fa64e-4542-472e-8ba8-63cab796a3b2 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:56.323896 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 510/1040] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:06:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:06:56.329046 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1aa0b-379b-471c-bf1a-c1e9df213c6d None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:56.329496 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1aa0b-379b-471c-bf1a-c1e9df213c6d None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:56.329598 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1aa0b-379b-471c-bf1a-c1e9df213c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:56.349460 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-45b1aa0b-379b-471c-bf1a-c1e9df213c6d None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:06:56.350618 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-45b1aa0b-379b-471c-bf1a-c1e9df213c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:06:56.358638 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 531/1041] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:06:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:06:56.514093 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076fa64e-4542-472e-8ba8-63cab796a3b2 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:06:56.533214 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076fa64e-4542-472e-8ba8-63cab796a3b2 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:06:56.539105 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c334270-9d0d-4198-a144-0774b9fdbc2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3796b1549762419686cb3b00af1a963e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:06:56.539742 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c334270-9d0d-4198-a144-0774b9fdbc2c service nova] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:56.540007 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c334270-9d0d-4198-a144-0774b9fdbc2c service nova] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:56.540270 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c334270-9d0d-4198-a144-0774b9fdbc2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:56.548928 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c334270-9d0d-4198-a144-0774b9fdbc2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:06:56.550508 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c334270-9d0d-4198-a144-0774b9fdbc2c service nova] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:06:56.559967 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 511/1042] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:06:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:06:57.421095 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f476799-5e4d-42b4-9e5f-9eaac68316e3 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:57.421665 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f476799-5e4d-42b4-9e5f-9eaac68316e3 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:57.421665 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f476799-5e4d-42b4-9e5f-9eaac68316e3 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:57.422972 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 532/1043] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:06:57.428161 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a19ffd-1af0-4b3b-9a47-5045746b2dfe None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:57.428611 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a19ffd-1af0-4b3b-9a47-5045746b2dfe None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:57.428702 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a19ffd-1af0-4b3b-9a47-5045746b2dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:57.449947 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-39a19ffd-1af0-4b3b-9a47-5045746b2dfe None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:06:57.451164 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-39a19ffd-1af0-4b3b-9a47-5045746b2dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:06:57.459876 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 512/1044] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:06:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:06:57.610804 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f476799-5e4d-42b4-9e5f-9eaac68316e3 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:06:57.625742 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f476799-5e4d-42b4-9e5f-9eaac68316e3 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:06:57.631091 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b61b9f-8e23-4475-909a-7342fdf7b97d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3796b1549762419686cb3b00af1a963e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:06:57.631712 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b61b9f-8e23-4475-909a-7342fdf7b97d service nova] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:57.631989 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b61b9f-8e23-4475-909a-7342fdf7b97d service nova] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:57.632253 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b61b9f-8e23-4475-909a-7342fdf7b97d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:57.640720 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b61b9f-8e23-4475-909a-7342fdf7b97d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:06:57.642326 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b61b9f-8e23-4475-909a-7342fdf7b97d service nova] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:06:57.651844 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 533/1045] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:06:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:06:58.453034 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa3327-c638-4588-b9b8-7a1f767ce92e None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:58.453608 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa3327-c638-4588-b9b8-7a1f767ce92e None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:58.453608 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa3327-c638-4588-b9b8-7a1f767ce92e None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:58.454917 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 513/1046] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:06:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:06:58.460050 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99cd9d-cce7-4685-aafc-61a61089e075 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:58.460483 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99cd9d-cce7-4685-aafc-61a61089e075 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:58.460601 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99cd9d-cce7-4685-aafc-61a61089e075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:58.481825 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-af99cd9d-cce7-4685-aafc-61a61089e075 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:06:58.483059 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-af99cd9d-cce7-4685-aafc-61a61089e075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:06:58.491548 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 534/1047] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:06:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:06:58.646424 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa3327-c638-4588-b9b8-7a1f767ce92e None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:06:58.660539 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa3327-c638-4588-b9b8-7a1f767ce92e None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:06:58.665699 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec494cfb-4b1e-44d1-b7a9-dabad9717c6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3796b1549762419686cb3b00af1a963e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:06:58.666289 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec494cfb-4b1e-44d1-b7a9-dabad9717c6e service nova] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:58.666562 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec494cfb-4b1e-44d1-b7a9-dabad9717c6e service nova] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:58.666829 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec494cfb-4b1e-44d1-b7a9-dabad9717c6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:58.675299 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec494cfb-4b1e-44d1-b7a9-dabad9717c6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:06:58.676893 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec494cfb-4b1e-44d1-b7a9-dabad9717c6e service nova] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:06:58.686957 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 514/1048] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:06:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:06:59.488063 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d17377-6cc3-459b-bd1a-1806acc13f2b None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:59.488662 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d17377-6cc3-459b-bd1a-1806acc13f2b None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:59.488662 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d17377-6cc3-459b-bd1a-1806acc13f2b None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:59.489912 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 535/1049] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:06:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:06:59.495241 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc382a-a066-4686-9a9a-81056eb523f2 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:59.495680 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc382a-a066-4686-9a9a-81056eb523f2 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:59.495796 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc382a-a066-4686-9a9a-81056eb523f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:59.516316 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-a8fc382a-a066-4686-9a9a-81056eb523f2 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:06:59.517445 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-a8fc382a-a066-4686-9a9a-81056eb523f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:06:59.526411 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 515/1050] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:06:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:06:59.695927 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d17377-6cc3-459b-bd1a-1806acc13f2b None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:06:59.710524 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d17377-6cc3-459b-bd1a-1806acc13f2b None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:06:59.716043 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0c59c-7d1b-4b9e-8d51-c332177a8d78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3796b1549762419686cb3b00af1a963e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:06:59.716631 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0c59c-7d1b-4b9e-8d51-c332177a8d78 service nova] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:59.716874 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0c59c-7d1b-4b9e-8d51-c332177a8d78 service nova] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:59.717161 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0c59c-7d1b-4b9e-8d51-c332177a8d78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:59.726010 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da0c59c-7d1b-4b9e-8d51-c332177a8d78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:06:59.727736 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da0c59c-7d1b-4b9e-8d51-c332177a8d78 service nova] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:06:59.737713 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 536/1051] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:06:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:07:00.552316 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28affe71-1b94-4c82-a8fc-b376f5ff16b1 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:07:00.552922 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28affe71-1b94-4c82-a8fc-b376f5ff16b1 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:07:00.552922 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28affe71-1b94-4c82-a8fc-b376f5ff16b1 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:07:00.554200 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 516/1052] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:07:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:07:00.559805 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f1a4c-7be7-44e0-8047-e73162673f8b None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:07:00.560275 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f1a4c-7be7-44e0-8047-e73162673f8b None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:07:00.560392 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f1a4c-7be7-44e0-8047-e73162673f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:07:00.581633 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-f30f1a4c-7be7-44e0-8047-e73162673f8b None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:07:00.582880 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-f30f1a4c-7be7-44e0-8047-e73162673f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:07:00.591957 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 537/1053] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:07:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:07:00.746009 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28affe71-1b94-4c82-a8fc-b376f5ff16b1 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:07:00.761237 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28affe71-1b94-4c82-a8fc-b376f5ff16b1 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:07:00.767773 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f882dfea-773e-4d95-994f-10ebb5f487ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3796b1549762419686cb3b00af1a963e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:07:00.768401 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882dfea-773e-4d95-994f-10ebb5f487ce service nova] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:07:00.768675 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882dfea-773e-4d95-994f-10ebb5f487ce service nova] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:07:00.768949 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882dfea-773e-4d95-994f-10ebb5f487ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:07:00.778269 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f882dfea-773e-4d95-994f-10ebb5f487ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:07:00.780204 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f882dfea-773e-4d95-994f-10ebb5f487ce service nova] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:07:00.790270 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 517/1054] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:07:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:07:01.597249 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59312eab-168d-4c3e-a32a-27fb6814880d None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:07:01.597830 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59312eab-168d-4c3e-a32a-27fb6814880d None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:07:01.597830 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59312eab-168d-4c3e-a32a-27fb6814880d None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:07:01.599123 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 538/1055] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:07:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:07:01.604628 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b0072-7840-4487-87bc-985a30763401 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:07:01.605098 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b0072-7840-4487-87bc-985a30763401 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:07:01.605217 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b0072-7840-4487-87bc-985a30763401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:07:01.627700 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-3e7b0072-7840-4487-87bc-985a30763401 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:07:01.628932 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-3e7b0072-7840-4487-87bc-985a30763401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:07:01.637979 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 518/1056] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:07:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:07:01.791600 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59312eab-168d-4c3e-a32a-27fb6814880d None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:07:01.807056 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59312eab-168d-4c3e-a32a-27fb6814880d None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:07:01.812578 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a7cee-60d4-4f23-87b0-46a77e0425b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3796b1549762419686cb3b00af1a963e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:07:01.813174 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a7cee-60d4-4f23-87b0-46a77e0425b3 service nova] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:07:01.813471 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a7cee-60d4-4f23-87b0-46a77e0425b3 service nova] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:07:01.813708 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a7cee-60d4-4f23-87b0-46a77e0425b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:07:01.823142 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88a7cee-60d4-4f23-87b0-46a77e0425b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:07:01.825258 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88a7cee-60d4-4f23-87b0-46a77e0425b3 service nova] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:07:01.836875 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 539/1057] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:07:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:07:03.909937 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d7938-22d4-4ce7-9490-822a5712d327 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:07:03.910496 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d7938-22d4-4ce7-9490-822a5712d327 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:07:03.910496 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d7938-22d4-4ce7-9490-822a5712d327 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:07:03.911847 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 519/1058] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:07:03.917400 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f4f2f-6c45-4bbd-8091-02424cb9a075 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:07:03.917844 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f4f2f-6c45-4bbd-8091-02424cb9a075 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:07:03.917972 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f4f2f-6c45-4bbd-8091-02424cb9a075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:07:03.938468 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-0c2f4f2f-6c45-4bbd-8091-02424cb9a075 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:07:03.939725 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-0c2f4f2f-6c45-4bbd-8091-02424cb9a075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:07:03.948360 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 540/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:07:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:07:04.292556 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d7938-22d4-4ce7-9490-822a5712d327 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:07:04.305040 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d7938-22d4-4ce7-9490-822a5712d327 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:07:04.309149 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e884323e-12a4-4dba-a5fd-6a2d51eaaf4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62f90d6440048e58cf530701a979e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:07:04.309869 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884323e-12a4-4dba-a5fd-6a2d51eaaf4d service neutron] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:07:04.310173 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884323e-12a4-4dba-a5fd-6a2d51eaaf4d service neutron] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:07:04.310448 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884323e-12a4-4dba-a5fd-6a2d51eaaf4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:07:04.321843 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e884323e-12a4-4dba-a5fd-6a2d51eaaf4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:07:04.323184 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e884323e-12a4-4dba-a5fd-6a2d51eaaf4d service neutron] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:07:04.333736 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 520/1060] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:07:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:07:06.685363 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488aa96-c879-4726-b1fb-5b0a0b2056e9 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:07:06.685909 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488aa96-c879-4726-b1fb-5b0a0b2056e9 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:07:06.685909 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488aa96-c879-4726-b1fb-5b0a0b2056e9 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:07:06.687145 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 541/1061] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:07:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:07:06.694193 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5b56c-dc4b-4da2-a31e-e3830bcc5330 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:07:06.694963 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5b56c-dc4b-4da2-a31e-e3830bcc5330 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:07:06.695124 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5b56c-dc4b-4da2-a31e-e3830bcc5330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:07:06.723056 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-9ff5b56c-dc4b-4da2-a31e-e3830bcc5330 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:07:06.724294 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-9ff5b56c-dc4b-4da2-a31e-e3830bcc5330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:07:06.733881 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 521/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:07:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:07:07.071802 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488aa96-c879-4726-b1fb-5b0a0b2056e9 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:07:07.084246 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488aa96-c879-4726-b1fb-5b0a0b2056e9 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:07:07.088478 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe56d7-ebb4-47cd-a00c-5eb0e9372376 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62f90d6440048e58cf530701a979e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:07:07.089068 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe56d7-ebb4-47cd-a00c-5eb0e9372376 service neutron] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:07:07.089337 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe56d7-ebb4-47cd-a00c-5eb0e9372376 service neutron] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:07:07.089601 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe56d7-ebb4-47cd-a00c-5eb0e9372376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:07:07.099302 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe56d7-ebb4-47cd-a00c-5eb0e9372376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:07:07.100749 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe56d7-ebb4-47cd-a00c-5eb0e9372376 service neutron] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:07:07.111015 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 542/1063] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:07:07 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:07:09.697649 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf102d63-bb34-4df0-a9a2-af9f247f9702 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:07:09.698238 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf102d63-bb34-4df0-a9a2-af9f247f9702 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:07:09.698238 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf102d63-bb34-4df0-a9a2-af9f247f9702 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:07:09.699643 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 522/1064] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:07:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:07:09.705238 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4226d2-4178-4495-bab2-755cf738dff6 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:07:09.705675 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4226d2-4178-4495-bab2-755cf738dff6 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:07:09.705771 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4226d2-4178-4495-bab2-755cf738dff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:07:09.726054 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-0f4226d2-4178-4495-bab2-755cf738dff6 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:07:09.727270 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-0f4226d2-4178-4495-bab2-755cf738dff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:07:09.736548 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 543/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:07:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:07:10.081889 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf102d63-bb34-4df0-a9a2-af9f247f9702 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:07:10.093886 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf102d63-bb34-4df0-a9a2-af9f247f9702 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:07:10.098385 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690bd47-7a1e-4158-9c23-a0d731d87a6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62f90d6440048e58cf530701a979e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:07:10.099013 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690bd47-7a1e-4158-9c23-a0d731d87a6a service neutron] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:07:10.099333 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690bd47-7a1e-4158-9c23-a0d731d87a6a service neutron] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:07:10.099598 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690bd47-7a1e-4158-9c23-a0d731d87a6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:07:10.109378 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7690bd47-7a1e-4158-9c23-a0d731d87a6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:07:10.110868 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7690bd47-7a1e-4158-9c23-a0d731d87a6a service neutron] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:07:10.121038 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 523/1066] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:07:10 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:07:12.513274 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473bd6d-5e02-4689-b980-d5cf11dfdd0e None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:07:12.513976 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473bd6d-5e02-4689-b980-d5cf11dfdd0e None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:07:12.513976 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473bd6d-5e02-4689-b980-d5cf11dfdd0e None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:07:12.515099 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 544/1067] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:07:12.520726 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e3d61-2b79-4119-9c21-5dc4909e398f None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:07:12.521184 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e3d61-2b79-4119-9c21-5dc4909e398f None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:07:12.521280 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e3d61-2b79-4119-9c21-5dc4909e398f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:07:12.542196 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-262e3d61-2b79-4119-9c21-5dc4909e398f None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:07:12.543505 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-262e3d61-2b79-4119-9c21-5dc4909e398f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:07:12.552585 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 524/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:07:12 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:07:12.890621 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473bd6d-5e02-4689-b980-d5cf11dfdd0e None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:07:12.903549 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473bd6d-5e02-4689-b980-d5cf11dfdd0e None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:07:12.907258 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6eab7-a1f3-4df2-afdc-2cd5b2dcb83e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62f90d6440048e58cf530701a979e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:07:12.907859 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6eab7-a1f3-4df2-afdc-2cd5b2dcb83e service neutron] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:07:12.908133 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6eab7-a1f3-4df2-afdc-2cd5b2dcb83e service neutron] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:07:12.908402 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6eab7-a1f3-4df2-afdc-2cd5b2dcb83e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:07:12.917987 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6eab7-a1f3-4df2-afdc-2cd5b2dcb83e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:07:12.919535 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6eab7-a1f3-4df2-afdc-2cd5b2dcb83e service neutron] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:07:12.929718 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 545/1069] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:07:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:07:15.153269 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c2410-d11c-4b23-ad0d-3ed8585d238a None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:07:15.153816 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c2410-d11c-4b23-ad0d-3ed8585d238a None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:07:15.153816 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c2410-d11c-4b23-ad0d-3ed8585d238a None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:07:15.155225 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 525/1070] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:07:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:07:15.161714 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8975e-0526-4e51-a3a2-6a271ca205f9 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:07:15.162195 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8975e-0526-4e51-a3a2-6a271ca205f9 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:07:15.162309 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8975e-0526-4e51-a3a2-6a271ca205f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:07:15.182296 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-a0f8975e-0526-4e51-a3a2-6a271ca205f9 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:07:15.183537 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-a0f8975e-0526-4e51-a3a2-6a271ca205f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:07:15.192627 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 546/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:07:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:07:15.531460 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c2410-d11c-4b23-ad0d-3ed8585d238a None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:07:15.543755 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c2410-d11c-4b23-ad0d-3ed8585d238a None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:07:15.547633 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb601f1-83cc-4762-a754-7be507e73f38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62f90d6440048e58cf530701a979e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:07:15.548229 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb601f1-83cc-4762-a754-7be507e73f38 service neutron] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:07:15.548510 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb601f1-83cc-4762-a754-7be507e73f38 service neutron] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:07:15.548779 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb601f1-83cc-4762-a754-7be507e73f38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:07:15.558581 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb601f1-83cc-4762-a754-7be507e73f38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:07:15.560151 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb601f1-83cc-4762-a754-7be507e73f38 service neutron] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:07:15.569938 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 526/1072] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:07:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:07:17.911997 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540d090-1443-497b-819b-54689633e827 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:07:17.912585 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540d090-1443-497b-819b-54689633e827 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:07:17.912585 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540d090-1443-497b-819b-54689633e827 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:07:17.913862 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 547/1073] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:07:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:07:17.919642 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb410d6-c63e-41b5-a373-3703d04b5cbd None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:07:17.920097 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb410d6-c63e-41b5-a373-3703d04b5cbd None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:07:17.920192 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb410d6-c63e-41b5-a373-3703d04b5cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:07:17.940695 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-ffb410d6-c63e-41b5-a373-3703d04b5cbd None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:07:17.941919 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-ffb410d6-c63e-41b5-a373-3703d04b5cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:07:17.951419 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 527/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:07:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:07:18.286725 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5540d090-1443-497b-819b-54689633e827 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:07:18.292506 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=64 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:07:18.299754 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5540d090-1443-497b-819b-54689633e827 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:07:18.304074 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d64beb0-9611-4230-8c92-a9d8d07f440e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62f90d6440048e58cf530701a979e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:07:18.304685 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64beb0-9611-4230-8c92-a9d8d07f440e service neutron] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:07:18.304997 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64beb0-9611-4230-8c92-a9d8d07f440e service neutron] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:07:18.305268 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d64beb0-9611-4230-8c92-a9d8d07f440e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:07:18.314817 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d64beb0-9611-4230-8c92-a9d8d07f440e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:07:18.316296 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d64beb0-9611-4230-8c92-a9d8d07f440e service neutron] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:07:18.326108 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 548/1075] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:07:18 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:07:20.589433 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46e89b-beff-493c-876c-06b1670cb38e None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:07:20.590045 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46e89b-beff-493c-876c-06b1670cb38e None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:07:20.590045 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46e89b-beff-493c-876c-06b1670cb38e None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:07:20.591529 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 528/1076] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:07:20.597219 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71329c97-1c07-4a88-ac38-189b22c96bb0 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:07:20.597693 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71329c97-1c07-4a88-ac38-189b22c96bb0 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:07:20.597803 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71329c97-1c07-4a88-ac38-189b22c96bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:07:20.617372 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-71329c97-1c07-4a88-ac38-189b22c96bb0 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:07:20.618579 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-71329c97-1c07-4a88-ac38-189b22c96bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:07:20.627174 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 549/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:07:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:07:20.972646 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46e89b-beff-493c-876c-06b1670cb38e None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:07:20.979338 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=73 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:07:20.986337 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46e89b-beff-493c-876c-06b1670cb38e None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:07:20.990200 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3965bf3-2c53-411c-ae8a-8ed4fe0575fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62f90d6440048e58cf530701a979e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:07:20.990818 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3965bf3-2c53-411c-ae8a-8ed4fe0575fe service neutron] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:07:20.991086 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3965bf3-2c53-411c-ae8a-8ed4fe0575fe service neutron] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:07:20.991398 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3965bf3-2c53-411c-ae8a-8ed4fe0575fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:07:21.001240 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3965bf3-2c53-411c-ae8a-8ed4fe0575fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:07:21.002715 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3965bf3-2c53-411c-ae8a-8ed4fe0575fe service neutron] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:07:21.012557 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 529/1078] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:07:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:07:23.220736 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032170e-f5fd-4d51-a3ac-680c4dbe2c90 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:07:23.221338 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032170e-f5fd-4d51-a3ac-680c4dbe2c90 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:07:23.221338 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032170e-f5fd-4d51-a3ac-680c4dbe2c90 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:07:23.222613 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 550/1079] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:07:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:07:23.228020 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76a725-f07a-4380-9c88-949eb92f1566 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:07:23.228496 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76a725-f07a-4380-9c88-949eb92f1566 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:07:23.228732 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76a725-f07a-4380-9c88-949eb92f1566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:07:23.249868 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-1f76a725-f07a-4380-9c88-949eb92f1566 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:07:23.251069 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-1f76a725-f07a-4380-9c88-949eb92f1566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:07:23.259837 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 530/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:07:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:07:23.599496 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032170e-f5fd-4d51-a3ac-680c4dbe2c90 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:07:23.612392 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032170e-f5fd-4d51-a3ac-680c4dbe2c90 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:07:23.616199 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7048b-86cb-4477-9d5d-0516a0d79ecf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62f90d6440048e58cf530701a979e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:07:23.616802 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7048b-86cb-4477-9d5d-0516a0d79ecf service neutron] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:07:23.617077 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7048b-86cb-4477-9d5d-0516a0d79ecf service neutron] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:07:23.617346 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7048b-86cb-4477-9d5d-0516a0d79ecf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:07:23.627250 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d7048b-86cb-4477-9d5d-0516a0d79ecf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:07:23.628721 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d7048b-86cb-4477-9d5d-0516a0d79ecf service neutron] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:07:23.638644 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 551/1081] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:07:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:07:25.832756 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ef0cf-658c-4545-aebb-700f27cf2a6f None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:07:25.833366 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ef0cf-658c-4545-aebb-700f27cf2a6f None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:07:25.833366 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ef0cf-658c-4545-aebb-700f27cf2a6f None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:07:25.834714 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 531/1082] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:07:25.840284 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9c551-42bf-4026-ab56-db6682604175 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:07:25.840720 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9c551-42bf-4026-ab56-db6682604175 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:07:25.840815 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9c551-42bf-4026-ab56-db6682604175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:07:25.861306 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-30c9c551-42bf-4026-ab56-db6682604175 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:07:25.862405 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-30c9c551-42bf-4026-ab56-db6682604175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:07:25.871467 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 552/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:07:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:07:26.204312 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ef0cf-658c-4545-aebb-700f27cf2a6f None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:07:26.218039 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ef0cf-658c-4545-aebb-700f27cf2a6f None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:07:26.222277 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0067ae7c-66ce-4af3-b500-ad8a0c4fadca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62f90d6440048e58cf530701a979e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:07:26.222862 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067ae7c-66ce-4af3-b500-ad8a0c4fadca service neutron] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:07:26.223140 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067ae7c-66ce-4af3-b500-ad8a0c4fadca service neutron] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:07:26.223446 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067ae7c-66ce-4af3-b500-ad8a0c4fadca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:07:26.236227 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0067ae7c-66ce-4af3-b500-ad8a0c4fadca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:07:26.237662 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0067ae7c-66ce-4af3-b500-ad8a0c4fadca service neutron] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:07:26.247497 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 532/1084] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:07:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:07:28.445608 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480a001-d266-488f-86ca-92c87bd6c928 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:07:28.446219 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480a001-d266-488f-86ca-92c87bd6c928 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:07:28.446219 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480a001-d266-488f-86ca-92c87bd6c928 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:07:28.447523 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 553/1085] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:07:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:07:28.453031 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cc45a-4b7f-4919-8682-004ca6782668 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:07:28.453493 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cc45a-4b7f-4919-8682-004ca6782668 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:07:28.453598 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7cc45a-4b7f-4919-8682-004ca6782668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:07:28.479239 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-3e7cc45a-4b7f-4919-8682-004ca6782668 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:07:28.480448 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-3e7cc45a-4b7f-4919-8682-004ca6782668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:07:28.488875 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 533/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:07:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:07:28.828755 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480a001-d266-488f-86ca-92c87bd6c928 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:07:28.841140 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480a001-d266-488f-86ca-92c87bd6c928 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:07:28.844990 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec452a-ad16-4622-a5d0-ed88e6046140 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62f90d6440048e58cf530701a979e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:07:28.845593 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec452a-ad16-4622-a5d0-ed88e6046140 service neutron] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:07:28.845873 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec452a-ad16-4622-a5d0-ed88e6046140 service neutron] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:07:28.846142 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec452a-ad16-4622-a5d0-ed88e6046140 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:07:28.855741 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ec452a-ad16-4622-a5d0-ed88e6046140 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:07:28.857181 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ec452a-ad16-4622-a5d0-ed88e6046140 service neutron] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:07:28.866924 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 554/1087] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:07:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:07:38.473935 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=17 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:07:38.862772 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=23 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:07:52.677386 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e6276-3084-4935-af9b-ce7b1462d806 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:07:52.678051 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e6276-3084-4935-af9b-ce7b1462d806 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:07:52.678051 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e6276-3084-4935-af9b-ce7b1462d806 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:07:52.679340 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 534/1088] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:07:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:07:52.685206 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246dc63-eba2-44d7-b31a-e48bb28e3eaa None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:07:52.685639 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246dc63-eba2-44d7-b31a-e48bb28e3eaa None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:07:52.685744 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246dc63-eba2-44d7-b31a-e48bb28e3eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:07:52.707556 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-e246dc63-eba2-44d7-b31a-e48bb28e3eaa None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:07:52.709073 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-e246dc63-eba2-44d7-b31a-e48bb28e3eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:07:52.718176 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 555/1089] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:07:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:07:53.078283 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b10d6-af5d-4e36-8edd-e0e201972587 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:07:53.078691 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b10d6-af5d-4e36-8edd-e0e201972587 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:07:53.079024 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b10d6-af5d-4e36-8edd-e0e201972587 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:07:53.080388 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 535/1090] 10.222.0.15 () {54 vars in 967 bytes} [Wed Aug 24 04:07:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:07:53.085808 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd9bbd-1c7b-44e2-bceb-0a326ff147b1 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:07:53.086136 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd9bbd-1c7b-44e2-bceb-0a326ff147b1 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:07:53.086392 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd9bbd-1c7b-44e2-bceb-0a326ff147b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:07:53.107155 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-0dbd9bbd-1c7b-44e2-bceb-0a326ff147b1 None None] MFA Rules not processed for user `7da73e8a2c7a4c5aafd1d3fbea603970`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:07:53.108397 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-0dbd9bbd-1c7b-44e2-bceb-0a326ff147b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:07:53.115981 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 556/1091] 10.222.0.15 () {58 vars in 1064 bytes} [Wed Aug 24 04:07:53 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:07:53.123914 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b10d6-af5d-4e36-8edd-e0e201972587 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:07:53.135954 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b10d6-af5d-4e36-8edd-e0e201972587 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:07:53.140108 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea5477-11d8-4d0d-afc9-849ad0c168ba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7da73e8a2c7a4c5aafd1d3fbea603970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:07:53.140703 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea5477-11d8-4d0d-afc9-849ad0c168ba service glance] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:07:53.140974 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea5477-11d8-4d0d-afc9-849ad0c168ba service glance] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:07:53.141242 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea5477-11d8-4d0d-afc9-849ad0c168ba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:07:53.151316 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea5477-11d8-4d0d-afc9-849ad0c168ba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:07:53.152791 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea5477-11d8-4d0d-afc9-849ad0c168ba service glance] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:07:53.162676 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 536/1092] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:07:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:07:55.492712 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01da8c-1ec2-44a0-a203-2eafb8cea234 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:07:55.493330 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01da8c-1ec2-44a0-a203-2eafb8cea234 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:07:55.493330 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01da8c-1ec2-44a0-a203-2eafb8cea234 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:07:55.494622 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 557/1093] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:07:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:07:55.501086 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdcd6a-37f3-47ba-8a4e-9cb38307f7cc None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:07:55.501579 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdcd6a-37f3-47ba-8a4e-9cb38307f7cc None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:07:55.501684 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdcd6a-37f3-47ba-8a4e-9cb38307f7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:07:55.522926 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-c6fdcd6a-37f3-47ba-8a4e-9cb38307f7cc None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:07:55.524201 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-c6fdcd6a-37f3-47ba-8a4e-9cb38307f7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:07:55.532589 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 537/1094] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:07:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:07:55.862472 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01da8c-1ec2-44a0-a203-2eafb8cea234 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:07:55.877003 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01da8c-1ec2-44a0-a203-2eafb8cea234 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:07:55.881876 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b3c94-8d2e-4967-b3a0-529dd16df326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d781cc0590648468fbe68aed993b0f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:07:55.882489 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b3c94-8d2e-4967-b3a0-529dd16df326 admin admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:07:55.882762 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b3c94-8d2e-4967-b3a0-529dd16df326 admin admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:07:55.883028 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b3c94-8d2e-4967-b3a0-529dd16df326 admin admin] PATH_INFO: `/v3/projects` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:07:55.883711 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b3c94-8d2e-4967-b3a0-529dd16df326 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:07:55.885548 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: WARNING py.warnings [None req-ab4b3c94-8d2e-4967-b3a0-529dd16df326 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:07:55.885548 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: warnings.warn(msg) Aug 24 04:07:55.885548 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: Aug 24 04:07:55.886789 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b3c94-8d2e-4967-b3a0-529dd16df326 admin admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:07:55.906847 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 558/1095] 10.222.0.15 () {56 vars in 1108 bytes} [Wed Aug 24 04:07:55 2022] GET /identity/v3/projects => generated 1606 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:07:58.162966 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627b2bd-4b59-47ea-8ed4-988a31810016 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:07:58.163679 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627b2bd-4b59-47ea-8ed4-988a31810016 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:07:58.163679 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627b2bd-4b59-47ea-8ed4-988a31810016 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:07:58.165096 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 538/1096] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:07:58.171419 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681832d-9108-4f60-9417-29d4ac8c17f4 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:07:58.171945 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681832d-9108-4f60-9417-29d4ac8c17f4 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:07:58.171945 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681832d-9108-4f60-9417-29d4ac8c17f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:07:58.194023 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-7681832d-9108-4f60-9417-29d4ac8c17f4 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:07:58.195307 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-7681832d-9108-4f60-9417-29d4ac8c17f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:07:58.204455 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 559/1097] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:07:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:07:58.564445 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7627b2bd-4b59-47ea-8ed4-988a31810016 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:07:58.579478 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7627b2bd-4b59-47ea-8ed4-988a31810016 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:07:58.584538 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b7bd13-ef46-450b-a8eb-2480a24d0171 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3796b1549762419686cb3b00af1a963e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:07:58.585152 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7bd13-ef46-450b-a8eb-2480a24d0171 service nova] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:07:58.585429 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7bd13-ef46-450b-a8eb-2480a24d0171 service nova] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:07:58.585698 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7bd13-ef46-450b-a8eb-2480a24d0171 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:07:58.594429 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b7bd13-ef46-450b-a8eb-2480a24d0171 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:07:58.596091 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b7bd13-ef46-450b-a8eb-2480a24d0171 service nova] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:07:58.606160 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 539/1098] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:07:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:08:00.999500 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40319d11-7ee1-4860-b612-4557e4d1430b None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:08:01.000091 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40319d11-7ee1-4860-b612-4557e4d1430b None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:08:01.000091 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40319d11-7ee1-4860-b612-4557e4d1430b None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:08:01.001980 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 560/1099] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:08:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:08:01.009489 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246c16e-b199-44b8-99f0-2fef8d07877a None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:08:01.009990 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246c16e-b199-44b8-99f0-2fef8d07877a None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:08:01.009990 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246c16e-b199-44b8-99f0-2fef8d07877a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:08:01.030247 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-b246c16e-b199-44b8-99f0-2fef8d07877a None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:08:01.031482 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-b246c16e-b199-44b8-99f0-2fef8d07877a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:08:01.039731 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 540/1100] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:08:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:08:01.379671 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40319d11-7ee1-4860-b612-4557e4d1430b None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:08:01.395750 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40319d11-7ee1-4860-b612-4557e4d1430b None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:08:01.400627 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a1a6d8-d918-4756-a99d-6e7a3980fa40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62f90d6440048e58cf530701a979e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:08:01.401435 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1a6d8-d918-4756-a99d-6e7a3980fa40 service neutron] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:08:01.401805 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1a6d8-d918-4756-a99d-6e7a3980fa40 service neutron] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:08:01.402177 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1a6d8-d918-4756-a99d-6e7a3980fa40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:08:01.414459 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a1a6d8-d918-4756-a99d-6e7a3980fa40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:08:01.416490 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a1a6d8-d918-4756-a99d-6e7a3980fa40 service neutron] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:08:01.429928 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 561/1101] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:08:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:08:04.019012 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8599bc-14bc-4997-a22b-ef9b3f09b34a None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:08:04.019603 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8599bc-14bc-4997-a22b-ef9b3f09b34a None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:08:04.019603 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8599bc-14bc-4997-a22b-ef9b3f09b34a None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:08:04.021079 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 541/1102] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:08:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:08:04.026950 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00776083-6281-43bc-a62b-54ae577dc386 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:08:04.027426 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00776083-6281-43bc-a62b-54ae577dc386 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:08:04.027543 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00776083-6281-43bc-a62b-54ae577dc386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:08:04.048848 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-00776083-6281-43bc-a62b-54ae577dc386 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:08:04.050050 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-00776083-6281-43bc-a62b-54ae577dc386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:08:04.058564 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 562/1103] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:08:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:08:04.401108 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8599bc-14bc-4997-a22b-ef9b3f09b34a None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:08:04.419611 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8599bc-14bc-4997-a22b-ef9b3f09b34a None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:08:04.423543 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e187e-1bf8-4e8c-8b62-f102a3b87650 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62f90d6440048e58cf530701a979e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:08:04.424447 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e187e-1bf8-4e8c-8b62-f102a3b87650 service neutron] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:08:04.424722 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e187e-1bf8-4e8c-8b62-f102a3b87650 service neutron] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:08:04.424985 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e187e-1bf8-4e8c-8b62-f102a3b87650 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:08:04.434727 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09e187e-1bf8-4e8c-8b62-f102a3b87650 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:08:04.436215 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09e187e-1bf8-4e8c-8b62-f102a3b87650 service neutron] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:08:04.446050 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 542/1104] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:08:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:08:06.741448 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbc7ba-8e61-48ea-bccd-7c360b0f362b None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:08:06.742319 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbc7ba-8e61-48ea-bccd-7c360b0f362b None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:08:06.742319 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbc7ba-8e61-48ea-bccd-7c360b0f362b None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:08:06.744330 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 563/1105] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:08:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:08:06.750883 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37cf07d-474d-4c4f-95b4-9ddd0ce6c35d None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:08:06.751755 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37cf07d-474d-4c4f-95b4-9ddd0ce6c35d None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:08:06.751755 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37cf07d-474d-4c4f-95b4-9ddd0ce6c35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:08:06.776792 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-d37cf07d-474d-4c4f-95b4-9ddd0ce6c35d None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:08:06.778010 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-d37cf07d-474d-4c4f-95b4-9ddd0ce6c35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:08:06.787670 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 543/1106] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:08:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:08:07.131535 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbc7ba-8e61-48ea-bccd-7c360b0f362b None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:08:07.147013 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbc7ba-8e61-48ea-bccd-7c360b0f362b None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:08:07.151488 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731f2bb-2a46-4343-8902-940e0ce2c182 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62f90d6440048e58cf530701a979e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:08:07.152131 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731f2bb-2a46-4343-8902-940e0ce2c182 service neutron] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:08:07.152432 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731f2bb-2a46-4343-8902-940e0ce2c182 service neutron] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:08:07.152699 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731f2bb-2a46-4343-8902-940e0ce2c182 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:08:07.162373 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731f2bb-2a46-4343-8902-940e0ce2c182 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:08:07.163861 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731f2bb-2a46-4343-8902-940e0ce2c182 service neutron] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:08:07.173830 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 564/1107] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:08:07 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:08:09.564149 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045d810-3cc5-422d-abb1-463962f2eb35 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:08:09.565053 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045d810-3cc5-422d-abb1-463962f2eb35 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:08:09.565053 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045d810-3cc5-422d-abb1-463962f2eb35 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:08:09.567477 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 544/1108] 10.222.0.15 () {54 vars in 927 bytes} [Wed Aug 24 04:08:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:08:09.575500 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89e75d-d8ed-45ea-8d89-ea44068384ae None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:08:09.575958 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89e75d-d8ed-45ea-8d89-ea44068384ae None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:08:09.576060 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89e75d-d8ed-45ea-8d89-ea44068384ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:08:09.597448 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-5c89e75d-d8ed-45ea-8d89-ea44068384ae None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:08:09.598659 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-5c89e75d-d8ed-45ea-8d89-ea44068384ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:08:09.607227 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 565/1109] 10.222.0.15 () {58 vars in 1024 bytes} [Wed Aug 24 04:08:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:08:09.941775 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045d810-3cc5-422d-abb1-463962f2eb35 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:08:09.955374 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045d810-3cc5-422d-abb1-463962f2eb35 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:08:09.960010 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e06db-78bb-4f0b-86d0-d09eaf7a132e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62f90d6440048e58cf530701a979e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:08:09.960610 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e06db-78bb-4f0b-86d0-d09eaf7a132e service neutron] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:08:09.960887 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e06db-78bb-4f0b-86d0-d09eaf7a132e service neutron] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:08:09.961159 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e06db-78bb-4f0b-86d0-d09eaf7a132e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:08:09.970961 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142e06db-78bb-4f0b-86d0-d09eaf7a132e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:08:09.972453 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142e06db-78bb-4f0b-86d0-d09eaf7a132e service neutron] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:08:09.983312 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 545/1110] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:08:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:08:19.592594 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=33 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:08:19.978444 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=33 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:09:24.953575 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bc876-c01d-4270-86b4-6daad5e3fe30 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:09:24.954217 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bc876-c01d-4270-86b4-6daad5e3fe30 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:09:24.954217 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bc876-c01d-4270-86b4-6daad5e3fe30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:09:24.974433 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-500bc876-c01d-4270-86b4-6daad5e3fe30 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:09:24.975727 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-500bc876-c01d-4270-86b4-6daad5e3fe30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:09:24.986681 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 566/1111] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 24 04:09:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:09:24.995698 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2470a4-958a-4d96-a308-eed8c4ab5abb None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:09:24.996331 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2470a4-958a-4d96-a308-eed8c4ab5abb None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:09:24.996331 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2470a4-958a-4d96-a308-eed8c4ab5abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:09:25.019382 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-5f2470a4-958a-4d96-a308-eed8c4ab5abb None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:09:25.020643 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-5f2470a4-958a-4d96-a308-eed8c4ab5abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:09:25.030246 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 546/1112] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 24 04:09:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:09:25.035179 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500bc876-c01d-4270-86b4-6daad5e3fe30 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:09:25.045696 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500bc876-c01d-4270-86b4-6daad5e3fe30 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:09:25.051255 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4838a9-507f-4ff2-8f37-091d2b87a74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d781cc0590648468fbe68aed993b0f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:09:25.051883 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4838a9-507f-4ff2-8f37-091d2b87a74f admin admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:09:25.052160 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4838a9-507f-4ff2-8f37-091d2b87a74f admin admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:09:25.052435 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4838a9-507f-4ff2-8f37-091d2b87a74f admin admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:09:25.053078 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4838a9-507f-4ff2-8f37-091d2b87a74f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:09:25.053376 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4838a9-507f-4ff2-8f37-091d2b87a74f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:09:25.054400 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: WARNING py.warnings [None req-bf4838a9-507f-4ff2-8f37-091d2b87a74f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:09:25.054400 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: warnings.warn(msg) Aug 24 04:09:25.054400 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: Aug 24 04:09:25.055342 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4838a9-507f-4ff2-8f37-091d2b87a74f admin admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:09:25.072099 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 567/1113] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 24 04:09:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:09:25.085318 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2470a4-958a-4d96-a308-eed8c4ab5abb None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:09:25.096028 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2470a4-958a-4d96-a308-eed8c4ab5abb None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:09:25.101160 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c5ad9-4cad-4e2e-960e-806e820e7899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d781cc0590648468fbe68aed993b0f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:09:25.101766 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c5ad9-4cad-4e2e-960e-806e820e7899 admin admin] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:09:25.102038 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c5ad9-4cad-4e2e-960e-806e820e7899 admin admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:09:25.102300 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c5ad9-4cad-4e2e-960e-806e820e7899 admin admin] PATH_INFO: `/v3/projects` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:09:25.102951 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c5ad9-4cad-4e2e-960e-806e820e7899 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:09:25.104743 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: WARNING py.warnings [None req-a36c5ad9-4cad-4e2e-960e-806e820e7899 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:09:25.104743 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: warnings.warn(msg) Aug 24 04:09:25.104743 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: Aug 24 04:09:25.105928 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c5ad9-4cad-4e2e-960e-806e820e7899 admin admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:09:25.138657 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 547/1114] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 24 04:09:25 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:09:25.142917 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4838a9-507f-4ff2-8f37-091d2b87a74f admin admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:09:25.153696 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4838a9-507f-4ff2-8f37-091d2b87a74f admin admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:09:25.219890 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2b6e0-cfe7-4a96-8e6e-ed35603eee75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d781cc0590648468fbe68aed993b0f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:09:25.220497 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2b6e0-cfe7-4a96-8e6e-ed35603eee75 admin admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:09:25.220775 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2b6e0-cfe7-4a96-8e6e-ed35603eee75 admin admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:09:25.221014 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2b6e0-cfe7-4a96-8e6e-ed35603eee75 admin admin] PATH_INFO: `/v3/users` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:09:25.221659 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad2b6e0-cfe7-4a96-8e6e-ed35603eee75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:09:25.222685 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: WARNING py.warnings [None req-0ad2b6e0-cfe7-4a96-8e6e-ed35603eee75 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:09:25.222685 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: warnings.warn(msg) Aug 24 04:09:25.222685 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: Aug 24 04:09:25.223949 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad2b6e0-cfe7-4a96-8e6e-ed35603eee75 admin admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:09:25.246576 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 568/1115] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 24 04:09:25 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:09:25.250871 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c5ad9-4cad-4e2e-960e-806e820e7899 admin admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:09:25.262161 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c5ad9-4cad-4e2e-960e-806e820e7899 admin admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:09:25.267025 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a383c9e-4154-48b7-8c1d-55ead9db8e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d781cc0590648468fbe68aed993b0f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:09:25.267669 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a383c9e-4154-48b7-8c1d-55ead9db8e33 admin admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:09:25.267956 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a383c9e-4154-48b7-8c1d-55ead9db8e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:09:25.268268 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a383c9e-4154-48b7-8c1d-55ead9db8e33 admin admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:09:25.269055 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a383c9e-4154-48b7-8c1d-55ead9db8e33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:09:25.269922 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: WARNING py.warnings [None req-3a383c9e-4154-48b7-8c1d-55ead9db8e33 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:09:25.269922 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: warnings.warn(msg) Aug 24 04:09:25.269922 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: Aug 24 04:09:25.270852 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a383c9e-4154-48b7-8c1d-55ead9db8e33 admin admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:09:25.284834 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 548/1116] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 24 04:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:09:25.290278 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2b6e0-cfe7-4a96-8e6e-ed35603eee75 admin admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:09:25.307054 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2b6e0-cfe7-4a96-8e6e-ed35603eee75 admin admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:09:25.314269 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435df013-55c9-4a58-8577-eebed52b8902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d781cc0590648468fbe68aed993b0f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:09:25.315063 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435df013-55c9-4a58-8577-eebed52b8902 admin admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:09:25.315404 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435df013-55c9-4a58-8577-eebed52b8902 admin admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:09:25.315750 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435df013-55c9-4a58-8577-eebed52b8902 admin admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:09:25.317295 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435df013-55c9-4a58-8577-eebed52b8902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:09:25.319067 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: WARNING py.warnings [None req-435df013-55c9-4a58-8577-eebed52b8902 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:09:25.319067 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: warnings.warn(msg) Aug 24 04:09:25.319067 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: Aug 24 04:09:25.320556 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435df013-55c9-4a58-8577-eebed52b8902 admin admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:09:25.336490 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 569/1117] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 24 04:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:09:25.340790 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a383c9e-4154-48b7-8c1d-55ead9db8e33 admin admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:09:25.351426 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a383c9e-4154-48b7-8c1d-55ead9db8e33 admin admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:09:25.357367 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae780fa-977d-463e-bddc-a73be9b79708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d781cc0590648468fbe68aed993b0f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:09:25.358414 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae780fa-977d-463e-bddc-a73be9b79708 admin admin] REQUEST_METHOD: `PUT` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:09:25.358796 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae780fa-977d-463e-bddc-a73be9b79708 admin admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:09:25.359116 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae780fa-977d-463e-bddc-a73be9b79708 admin admin] PATH_INFO: `/v3/projects/d48b884b38914cf18717aa451b2b82c2/users/d816f296ae00481ab1e5182c20fcf429/roles/5d03284e31284f60bcc99e4843279067` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:09:25.382383 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae780fa-977d-463e-bddc-a73be9b79708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d48b884b38914cf18717aa451b2b82c2, user_id=d816f296ae00481ab1e5182c20fcf429, role_id=5d03284e31284f60bcc99e4843279067)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:09:25.383467 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: WARNING py.warnings [None req-1ae780fa-977d-463e-bddc-a73be9b79708 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:09:25.383467 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: warnings.warn(msg) Aug 24 04:09:25.383467 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: Aug 24 04:09:25.385439 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae780fa-977d-463e-bddc-a73be9b79708 admin admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:09:25.400093 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 549/1118] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 24 04:09:25 2022] PUT /identity/v3/projects/d48b884b38914cf18717aa451b2b82c2/users/d816f296ae00481ab1e5182c20fcf429/roles/5d03284e31284f60bcc99e4843279067 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:09:25.412587 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0903db8-3b68-4576-a463-c1695b0e3b30 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:09:25.412793 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0903db8-3b68-4576-a463-c1695b0e3b30 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:09:25.413018 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0903db8-3b68-4576-a463-c1695b0e3b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:09:25.442886 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-e0903db8-3b68-4576-a463-c1695b0e3b30 None None] MFA Rules not processed for user `d816f296ae00481ab1e5182c20fcf429`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:09:25.444144 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-e0903db8-3b68-4576-a463-c1695b0e3b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:09:25.516408 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 570/1119] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 24 04:09:25 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:09:25.529952 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e7d4c-e5fe-423b-9dd1-8d212dc83160 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:09:25.530238 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e7d4c-e5fe-423b-9dd1-8d212dc83160 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:09:25.530512 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e7d4c-e5fe-423b-9dd1-8d212dc83160 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:09:25.531897 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 550/1120] 10.222.0.15 () {54 vars in 964 bytes} [Wed Aug 24 04:09:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:09:25.538735 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a913072-3dbf-4342-bc3f-368e492b468d None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:09:25.539093 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a913072-3dbf-4342-bc3f-368e492b468d None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:09:25.539494 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a913072-3dbf-4342-bc3f-368e492b468d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:09:25.560702 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-5a913072-3dbf-4342-bc3f-368e492b468d None None] MFA Rules not processed for user `9d60ca48fd1b4a4ab4261ad1dbd6c8bc`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:09:25.561909 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-5a913072-3dbf-4342-bc3f-368e492b468d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:09:25.608674 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:09:25.619530 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 571/1121] 10.222.0.15 () {58 vars in 1061 bytes} [Wed Aug 24 04:09:25 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:09:25.627230 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e7d4c-e5fe-423b-9dd1-8d212dc83160 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:09:25.641795 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e7d4c-e5fe-423b-9dd1-8d212dc83160 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:09:25.647351 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b10442-58aa-4c94-826b-0b4b9df92644 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d60ca48fd1b4a4ab4261ad1dbd6c8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:09:25.648150 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b10442-58aa-4c94-826b-0b4b9df92644 service cinder] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:09:25.648463 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b10442-58aa-4c94-826b-0b4b9df92644 service cinder] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:09:25.648899 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b10442-58aa-4c94-826b-0b4b9df92644 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:09:25.658489 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b10442-58aa-4c94-826b-0b4b9df92644 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:09:25.659977 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b10442-58aa-4c94-826b-0b4b9df92644 service cinder] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:09:25.669645 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 551/1122] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:09:25 2022] GET /identity/v3/auth/tokens => generated 2812 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:09:25.710169 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d9508-4845-4b72-8f67-66611c26b4d7 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:09:25.710562 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d9508-4845-4b72-8f67-66611c26b4d7 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:09:25.710953 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d9508-4845-4b72-8f67-66611c26b4d7 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:09:25.712910 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 572/1123] 10.222.0.15 () {52 vars in 830 bytes} [Wed Aug 24 04:09:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:09:25.716438 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b10442-58aa-4c94-826b-0b4b9df92644 service cinder] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:09:25.786034 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b10442-58aa-4c94-826b-0b4b9df92644 service cinder] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:09:25.790834 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940c272-99b7-450b-a0fa-944383cdc4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d781cc0590648468fbe68aed993b0f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:09:25.791492 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940c272-99b7-450b-a0fa-944383cdc4b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:09:25.791757 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940c272-99b7-450b-a0fa-944383cdc4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:09:25.792054 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940c272-99b7-450b-a0fa-944383cdc4b1 admin admin] PATH_INFO: `/v3/users/d816f296ae00481ab1e5182c20fcf429` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:09:25.795330 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940c272-99b7-450b-a0fa-944383cdc4b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d816f296ae00481ab1e5182c20fcf429)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:09:25.796360 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: WARNING py.warnings [None req-7940c272-99b7-450b-a0fa-944383cdc4b1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:09:25.796360 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: warnings.warn(msg) Aug 24 04:09:25.796360 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: Aug 24 04:09:25.797564 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940c272-99b7-450b-a0fa-944383cdc4b1 admin admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:09:25.877726 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-7940c272-99b7-450b-a0fa-944383cdc4b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd816f296ae00481ab1e5182c20fcf429'} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:09:25.878453 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-7940c272-99b7-450b-a0fa-944383cdc4b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd816f296ae00481ab1e5182c20fcf429'} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:09:25.893811 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-7940c272-99b7-450b-a0fa-944383cdc4b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd816f296ae00481ab1e5182c20fcf429'} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:09:25.894702 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-7940c272-99b7-450b-a0fa-944383cdc4b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd816f296ae00481ab1e5182c20fcf429'} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:09:25.914660 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-7940c272-99b7-450b-a0fa-944383cdc4b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd816f296ae00481ab1e5182c20fcf429'} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:09:25.950172 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 552/1124] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 24 04:09:25 2022] DELETE /identity/v3/users/d816f296ae00481ab1e5182c20fcf429 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:09:25.954683 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f406a-3479-40d1-9708-f03867733e83 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:09:25.955178 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f406a-3479-40d1-9708-f03867733e83 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:09:25.955325 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f406a-3479-40d1-9708-f03867733e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:09:25.975901 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-ea8f406a-3479-40d1-9708-f03867733e83 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:09:25.977126 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-ea8f406a-3479-40d1-9708-f03867733e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:09:26.049793 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 573/1125] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 24 04:09:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:09:26.062182 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940c272-99b7-450b-a0fa-944383cdc4b1 admin admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:09:26.063854 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-7940c272-99b7-450b-a0fa-944383cdc4b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:09:26.069880 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:09:26.134666 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940c272-99b7-450b-a0fa-944383cdc4b1 admin admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:09:26.138754 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295a966-11ac-47ac-ac45-609c2e56c978 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62f90d6440048e58cf530701a979e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:09:26.139511 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295a966-11ac-47ac-ac45-609c2e56c978 service neutron] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:09:26.139789 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295a966-11ac-47ac-ac45-609c2e56c978 service neutron] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:09:26.140059 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295a966-11ac-47ac-ac45-609c2e56c978 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:09:26.150279 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295a966-11ac-47ac-ac45-609c2e56c978 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:09:26.151760 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295a966-11ac-47ac-ac45-609c2e56c978 service neutron] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:09:26.161874 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 553/1126] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:09:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:09:26.549335 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f406a-3479-40d1-9708-f03867733e83 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:09:26.551081 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-ea8f406a-3479-40d1-9708-f03867733e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:09:26.564081 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f406a-3479-40d1-9708-f03867733e83 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:09:26.570051 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2feb6b-d292-4cf0-9dd1-931dc1702431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d781cc0590648468fbe68aed993b0f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:09:26.570698 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2feb6b-d292-4cf0-9dd1-931dc1702431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:09:26.571020 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2feb6b-d292-4cf0-9dd1-931dc1702431 admin admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:09:26.571312 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2feb6b-d292-4cf0-9dd1-931dc1702431 admin admin] PATH_INFO: `/v3/projects/d48b884b38914cf18717aa451b2b82c2` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:09:26.572589 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2feb6b-d292-4cf0-9dd1-931dc1702431 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d48b884b38914cf18717aa451b2b82c2)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:09:26.573634 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: WARNING py.warnings [None req-9b2feb6b-d292-4cf0-9dd1-931dc1702431 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:09:26.573634 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: warnings.warn(msg) Aug 24 04:09:26.573634 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: Aug 24 04:09:26.574861 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2feb6b-d292-4cf0-9dd1-931dc1702431 admin admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:09:26.650583 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-9b2feb6b-d292-4cf0-9dd1-931dc1702431 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd48b884b38914cf18717aa451b2b82c2', 'request_id': 'req-9b2feb6b-d292-4cf0-9dd1-931dc1702431'} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:09:26.661706 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-9b2feb6b-d292-4cf0-9dd1-931dc1702431 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd48b884b38914cf18717aa451b2b82c2', 'request_id': 'req-9b2feb6b-d292-4cf0-9dd1-931dc1702431'} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:09:26.676373 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-9b2feb6b-d292-4cf0-9dd1-931dc1702431 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd48b884b38914cf18717aa451b2b82c2', 'request_id': 'req-9b2feb6b-d292-4cf0-9dd1-931dc1702431'} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:09:26.688669 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-9b2feb6b-d292-4cf0-9dd1-931dc1702431 admin admin] The token cache is being invalidate because project d48b884b38914cf18717aa451b2b82c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:09:26.688952 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-9b2feb6b-d292-4cf0-9dd1-931dc1702431 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:09:26.689614 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-9b2feb6b-d292-4cf0-9dd1-931dc1702431 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:09:26.691250 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 574/1127] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 24 04:09:26 2022] DELETE /identity/v3/projects/d48b884b38914cf18717aa451b2b82c2 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:09:36.157358 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=25 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:09:36.685138 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:10:57.139649 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125532d2-7ec6-498c-996f-6015bf5cd159 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:10:57.140314 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125532d2-7ec6-498c-996f-6015bf5cd159 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:10:57.140314 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125532d2-7ec6-498c-996f-6015bf5cd159 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:10:57.141533 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 554/1128] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:10:57.146868 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39637e37-c4b4-4516-8ab5-9636a59654d0 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:10:57.147398 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39637e37-c4b4-4516-8ab5-9636a59654d0 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:10:57.147398 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39637e37-c4b4-4516-8ab5-9636a59654d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:10:57.224623 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-39637e37-c4b4-4516-8ab5-9636a59654d0 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:10:57.226245 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-39637e37-c4b4-4516-8ab5-9636a59654d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:10:57.383453 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 575/1129] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:10:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:10:57.545280 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125532d2-7ec6-498c-996f-6015bf5cd159 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:10:57.547203 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-125532d2-7ec6-498c-996f-6015bf5cd159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:10:57.641238 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125532d2-7ec6-498c-996f-6015bf5cd159 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:10:57.646483 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317aa13-5973-4831-92a7-3db2c58c0129 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3796b1549762419686cb3b00af1a963e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:10:57.647088 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317aa13-5973-4831-92a7-3db2c58c0129 service nova] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:10:57.647458 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317aa13-5973-4831-92a7-3db2c58c0129 service nova] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:10:57.647725 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317aa13-5973-4831-92a7-3db2c58c0129 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:10:57.656526 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9317aa13-5973-4831-92a7-3db2c58c0129 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:10:57.658133 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9317aa13-5973-4831-92a7-3db2c58c0129 service nova] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:10:57.668251 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 555/1130] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:10:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:10:58.511122 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b400a89-d487-4f27-abfb-1def18b3df9f None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:10:58.511795 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b400a89-d487-4f27-abfb-1def18b3df9f None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:10:58.511795 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b400a89-d487-4f27-abfb-1def18b3df9f None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:10:58.513123 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 576/1131] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:10:58.518670 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456e6fe-2752-4ded-bb02-c1371efbdc46 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:10:58.519272 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456e6fe-2752-4ded-bb02-c1371efbdc46 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:10:58.519272 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456e6fe-2752-4ded-bb02-c1371efbdc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:10:58.546274 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-e456e6fe-2752-4ded-bb02-c1371efbdc46 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:10:58.547551 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-e456e6fe-2752-4ded-bb02-c1371efbdc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:10:58.556595 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 556/1132] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:10:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:10:58.714160 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b400a89-d487-4f27-abfb-1def18b3df9f None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:10:58.728503 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b400a89-d487-4f27-abfb-1def18b3df9f None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:10:58.733518 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9274337-f07a-416a-8bbe-9e806b376509 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3796b1549762419686cb3b00af1a963e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:10:58.734121 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9274337-f07a-416a-8bbe-9e806b376509 service nova] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:10:58.734398 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9274337-f07a-416a-8bbe-9e806b376509 service nova] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:10:58.734667 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9274337-f07a-416a-8bbe-9e806b376509 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:10:58.743716 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9274337-f07a-416a-8bbe-9e806b376509 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:10:58.745318 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9274337-f07a-416a-8bbe-9e806b376509 service nova] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:10:58.755780 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 577/1133] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:10:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:11:03.772534 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a93d47-4b92-40a7-a603-c77039e4aaa3 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:11:03.773188 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a93d47-4b92-40a7-a603-c77039e4aaa3 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:11:03.773188 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a93d47-4b92-40a7-a603-c77039e4aaa3 None None] PATH_INFO: `/v3` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:11:03.774357 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 557/1134] 10.222.0.17 () {54 vars in 925 bytes} [Wed Aug 24 04:11:03 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:11:03.780833 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f14f26-1080-473c-bebd-39677b8d207f None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:11:03.781303 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f14f26-1080-473c-bebd-39677b8d207f None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:11:03.781427 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f14f26-1080-473c-bebd-39677b8d207f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:11:03.812301 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-31f14f26-1080-473c-bebd-39677b8d207f None None] MFA Rules not processed for user `a3f34384ad354405a69b3cfa242e9504`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:11:03.813522 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-31f14f26-1080-473c-bebd-39677b8d207f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:11:03.872470 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:11:03.883492 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 578/1135] 10.222.0.17 () {58 vars in 1015 bytes} [Wed Aug 24 04:11:03 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:11:08.535287 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=42 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:11:09.973939 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb709049-7308-4de3-897e-5539458afbdb None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:11:09.974739 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb709049-7308-4de3-897e-5539458afbdb None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:11:09.974739 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb709049-7308-4de3-897e-5539458afbdb None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:11:09.975939 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 558/1136] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:11:09.981168 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082c38a-ddd1-4aa9-94c9-9e7a5ead094e None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:11:09.981679 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082c38a-ddd1-4aa9-94c9-9e7a5ead094e None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:11:09.981775 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082c38a-ddd1-4aa9-94c9-9e7a5ead094e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:11:10.005025 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-d082c38a-ddd1-4aa9-94c9-9e7a5ead094e None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:11:10.006502 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-d082c38a-ddd1-4aa9-94c9-9e7a5ead094e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:11:10.016359 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 579/1137] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:11:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:11:10.177227 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb709049-7308-4de3-897e-5539458afbdb None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:11:10.192325 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb709049-7308-4de3-897e-5539458afbdb None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:11:10.198205 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874106a2-37a5-4004-8eba-61514c6d962d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3796b1549762419686cb3b00af1a963e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:11:10.198928 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874106a2-37a5-4004-8eba-61514c6d962d service nova] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:11:10.199310 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874106a2-37a5-4004-8eba-61514c6d962d service nova] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:11:10.199640 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874106a2-37a5-4004-8eba-61514c6d962d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:11:10.209566 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874106a2-37a5-4004-8eba-61514c6d962d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:11:10.211162 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874106a2-37a5-4004-8eba-61514c6d962d service nova] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:11:10.221309 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 559/1138] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:11:10 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:11:11.044395 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2b51f-4668-45e6-a10c-698446dcfb05 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:11:11.044986 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2b51f-4668-45e6-a10c-698446dcfb05 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:11:11.044986 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2b51f-4668-45e6-a10c-698446dcfb05 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:11:11.046335 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 580/1139] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:11:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:11:11.051462 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eed048-ea9a-484c-b2e0-0f51800ab463 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:11:11.051919 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eed048-ea9a-484c-b2e0-0f51800ab463 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:11:11.052025 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eed048-ea9a-484c-b2e0-0f51800ab463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:11:11.072719 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-78eed048-ea9a-484c-b2e0-0f51800ab463 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:11:11.073914 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-78eed048-ea9a-484c-b2e0-0f51800ab463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:11:11.082190 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 560/1140] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:11:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:11:11.239622 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2b51f-4668-45e6-a10c-698446dcfb05 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:11:11.255669 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2b51f-4668-45e6-a10c-698446dcfb05 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:11:11.262526 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d1dd7-edd7-4775-b221-9922e883074c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3796b1549762419686cb3b00af1a963e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:11:11.263221 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d1dd7-edd7-4775-b221-9922e883074c service nova] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:11:11.263543 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d1dd7-edd7-4775-b221-9922e883074c service nova] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:11:11.263920 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d1dd7-edd7-4775-b221-9922e883074c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:11:11.274108 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d1dd7-edd7-4775-b221-9922e883074c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:11:11.275929 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d1dd7-edd7-4775-b221-9922e883074c service nova] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:11:11.287231 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 581/1141] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:11:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:11:13.461743 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5e2ec-6d44-421f-b29a-3d00dc1f5451 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:11:13.462286 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5e2ec-6d44-421f-b29a-3d00dc1f5451 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:11:13.462286 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5e2ec-6d44-421f-b29a-3d00dc1f5451 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:11:13.463623 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 561/1142] 10.222.0.15 () {54 vars in 961 bytes} [Wed Aug 24 04:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:11:13.470025 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e057b-f21a-475f-9d67-28fedeb859c3 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:11:13.470529 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e057b-f21a-475f-9d67-28fedeb859c3 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:11:13.470634 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e057b-f21a-475f-9d67-28fedeb859c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:11:13.493066 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-6d2e057b-f21a-475f-9d67-28fedeb859c3 None None] MFA Rules not processed for user `a3f34384ad354405a69b3cfa242e9504`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:11:13.494292 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-6d2e057b-f21a-475f-9d67-28fedeb859c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:11:13.503935 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 582/1143] 10.222.0.15 () {58 vars in 1058 bytes} [Wed Aug 24 04:11:13 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:11:13.511462 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a5e2ec-6d44-421f-b29a-3d00dc1f5451 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:11:13.526824 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a5e2ec-6d44-421f-b29a-3d00dc1f5451 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:11:13.532253 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ae3c3c-0df9-4902-ab79-0d8870317d6e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3f34384ad354405a69b3cfa242e9504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:11:13.532832 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae3c3c-0df9-4902-ab79-0d8870317d6e service placement] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:11:13.533107 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae3c3c-0df9-4902-ab79-0d8870317d6e service placement] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:11:13.533376 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae3c3c-0df9-4902-ab79-0d8870317d6e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:11:13.542612 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ae3c3c-0df9-4902-ab79-0d8870317d6e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:11:13.544259 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ae3c3c-0df9-4902-ab79-0d8870317d6e service placement] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:11:13.554386 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 562/1144] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:11:13 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:11:22.529483 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32902445-a848-4fe6-b1bf-8286c651ba74 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:11:22.530623 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32902445-a848-4fe6-b1bf-8286c651ba74 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:11:22.530623 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32902445-a848-4fe6-b1bf-8286c651ba74 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:11:22.531380 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 583/1145] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:11:22.536702 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f512ef6-fcbd-4c7d-9132-9d14f5ee4fc9 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:11:22.537273 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f512ef6-fcbd-4c7d-9132-9d14f5ee4fc9 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:11:22.537273 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f512ef6-fcbd-4c7d-9132-9d14f5ee4fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:11:22.558224 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-1f512ef6-fcbd-4c7d-9132-9d14f5ee4fc9 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:11:22.559585 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-1f512ef6-fcbd-4c7d-9132-9d14f5ee4fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:11:22.569548 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 563/1146] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:11:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:11:22.728198 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32902445-a848-4fe6-b1bf-8286c651ba74 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:11:22.743355 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32902445-a848-4fe6-b1bf-8286c651ba74 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:11:22.749911 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705567b-c798-466a-be91-a7db64d93e80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3796b1549762419686cb3b00af1a963e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:11:22.750330 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705567b-c798-466a-be91-a7db64d93e80 service nova] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:11:22.750583 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705567b-c798-466a-be91-a7db64d93e80 service nova] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:11:22.750881 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705567b-c798-466a-be91-a7db64d93e80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:11:22.760831 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6705567b-c798-466a-be91-a7db64d93e80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:11:22.762439 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6705567b-c798-466a-be91-a7db64d93e80 service nova] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:11:22.773436 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 584/1147] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:11:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:11:23.619009 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1673e-783f-49c6-bf7f-da028032415f None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:11:23.619641 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1673e-783f-49c6-bf7f-da028032415f None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:11:23.619641 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1673e-783f-49c6-bf7f-da028032415f None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:11:23.620938 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 564/1148] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:11:23.626836 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab8d5d-ac5c-4959-a29f-d8126431d714 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:11:23.627444 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab8d5d-ac5c-4959-a29f-d8126431d714 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:11:23.627444 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab8d5d-ac5c-4959-a29f-d8126431d714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:11:23.651778 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-a3ab8d5d-ac5c-4959-a29f-d8126431d714 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:11:23.653041 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-a3ab8d5d-ac5c-4959-a29f-d8126431d714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:11:23.661793 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 585/1149] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:11:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:11:23.820862 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb1673e-783f-49c6-bf7f-da028032415f None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:11:23.836175 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb1673e-783f-49c6-bf7f-da028032415f None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:11:23.841605 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0e346-22ef-4e89-977f-f7719b896915 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3796b1549762419686cb3b00af1a963e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:11:23.842279 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0e346-22ef-4e89-977f-f7719b896915 service nova] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:11:23.842556 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0e346-22ef-4e89-977f-f7719b896915 service nova] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:11:23.842828 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0e346-22ef-4e89-977f-f7719b896915 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:11:23.852458 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0e346-22ef-4e89-977f-f7719b896915 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:11:23.854116 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0e346-22ef-4e89-977f-f7719b896915 service nova] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:11:23.865104 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 565/1150] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:11:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:11:28.659559 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b0974-7841-4002-a17a-ada8a463c97e None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:11:28.660466 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b0974-7841-4002-a17a-ada8a463c97e None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:11:28.660466 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b0974-7841-4002-a17a-ada8a463c97e None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:11:28.661706 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 586/1151] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:11:28.669201 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22f4a3-8a36-4cd4-9bc1-cb79f81c5a45 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:11:28.670070 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22f4a3-8a36-4cd4-9bc1-cb79f81c5a45 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:11:28.670070 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22f4a3-8a36-4cd4-9bc1-cb79f81c5a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:11:28.699162 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-be22f4a3-8a36-4cd4-9bc1-cb79f81c5a45 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:11:28.701286 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-be22f4a3-8a36-4cd4-9bc1-cb79f81c5a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:11:28.715028 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 566/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:11:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:11:29.074339 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b0974-7841-4002-a17a-ada8a463c97e None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:11:29.076378 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-ab8b0974-7841-4002-a17a-ada8a463c97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:11:29.164310 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b0974-7841-4002-a17a-ada8a463c97e None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:11:29.168918 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4675f4db-3bc9-453a-ab09-0c43bef451ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62f90d6440048e58cf530701a979e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:11:29.169597 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675f4db-3bc9-453a-ab09-0c43bef451ce service neutron] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:11:29.169910 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675f4db-3bc9-453a-ab09-0c43bef451ce service neutron] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:11:29.170209 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675f4db-3bc9-453a-ab09-0c43bef451ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:11:29.180944 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4675f4db-3bc9-453a-ab09-0c43bef451ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:11:29.182547 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4675f4db-3bc9-453a-ab09-0c43bef451ce service neutron] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:11:29.194546 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 587/1153] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:11:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:11:31.575377 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd164cd9-17da-4e83-88eb-7eadc7e06160 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:11:31.576328 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd164cd9-17da-4e83-88eb-7eadc7e06160 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:11:31.576328 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd164cd9-17da-4e83-88eb-7eadc7e06160 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:11:31.578301 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 567/1154] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:11:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:11:31.584994 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d3bae-dd16-4072-997c-4ddc5f55a804 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:11:31.585623 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d3bae-dd16-4072-997c-4ddc5f55a804 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:11:31.585623 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d3bae-dd16-4072-997c-4ddc5f55a804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:11:31.606899 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-2e9d3bae-dd16-4072-997c-4ddc5f55a804 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:11:31.608298 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-2e9d3bae-dd16-4072-997c-4ddc5f55a804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:11:31.617179 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 588/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:11:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:11:31.965564 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd164cd9-17da-4e83-88eb-7eadc7e06160 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:11:31.967590 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-cd164cd9-17da-4e83-88eb-7eadc7e06160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:11:31.982157 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd164cd9-17da-4e83-88eb-7eadc7e06160 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:11:31.986430 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b694cf-c2c6-4f70-b2e7-d1c98594c4e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62f90d6440048e58cf530701a979e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:11:31.987053 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b694cf-c2c6-4f70-b2e7-d1c98594c4e6 service neutron] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:11:31.987371 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b694cf-c2c6-4f70-b2e7-d1c98594c4e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:11:31.987644 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b694cf-c2c6-4f70-b2e7-d1c98594c4e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:11:31.999370 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b694cf-c2c6-4f70-b2e7-d1c98594c4e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:11:32.001053 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b694cf-c2c6-4f70-b2e7-d1c98594c4e6 service neutron] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:11:32.012678 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 568/1156] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:11:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:11:36.036428 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc55c9-421e-48a6-baa6-e490db08e3cc None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:11:36.037121 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc55c9-421e-48a6-baa6-e490db08e3cc None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:11:36.037121 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc55c9-421e-48a6-baa6-e490db08e3cc None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:11:36.038787 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 589/1157] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:11:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:11:36.045435 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d7695-5d84-49e6-8a2e-2089c6ef1594 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:11:36.046104 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d7695-5d84-49e6-8a2e-2089c6ef1594 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:11:36.046104 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d7695-5d84-49e6-8a2e-2089c6ef1594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:11:36.070053 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-448d7695-5d84-49e6-8a2e-2089c6ef1594 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:11:36.071353 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-448d7695-5d84-49e6-8a2e-2089c6ef1594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:11:36.079835 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 569/1158] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:11:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:11:36.683324 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc55c9-421e-48a6-baa6-e490db08e3cc None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:11:36.685208 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-abfc55c9-421e-48a6-baa6-e490db08e3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:11:36.689892 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=56 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:11:36.772862 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc55c9-421e-48a6-baa6-e490db08e3cc None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:11:36.777131 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea825c-b024-47f9-b6a1-1403a0131a27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d60ca48fd1b4a4ab4261ad1dbd6c8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:11:36.777766 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea825c-b024-47f9-b6a1-1403a0131a27 service cinder] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:11:36.778048 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea825c-b024-47f9-b6a1-1403a0131a27 service cinder] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:11:36.778319 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea825c-b024-47f9-b6a1-1403a0131a27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:11:36.790968 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea825c-b024-47f9-b6a1-1403a0131a27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:11:36.792570 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea825c-b024-47f9-b6a1-1403a0131a27 service cinder] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:11:36.804988 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 590/1159] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:11:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:11:39.130671 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d478f6-9a2d-4476-bb7d-92bdb1dc6f89 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:11:39.131273 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d478f6-9a2d-4476-bb7d-92bdb1dc6f89 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:11:39.131584 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d478f6-9a2d-4476-bb7d-92bdb1dc6f89 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:11:39.134043 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 570/1160] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:11:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:11:39.147537 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f22f9-0434-48dc-b3f3-30900874592b None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:11:39.148139 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f22f9-0434-48dc-b3f3-30900874592b None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:11:39.148139 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f22f9-0434-48dc-b3f3-30900874592b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:11:39.169005 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-dc3f22f9-0434-48dc-b3f3-30900874592b None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:11:39.170237 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-dc3f22f9-0434-48dc-b3f3-30900874592b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:11:39.178275 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 591/1161] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:11:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:11:39.767701 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d478f6-9a2d-4476-bb7d-92bdb1dc6f89 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:11:39.770062 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-59d478f6-9a2d-4476-bb7d-92bdb1dc6f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:11:39.779390 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=37 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:11:39.788198 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d478f6-9a2d-4476-bb7d-92bdb1dc6f89 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:11:39.792655 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c5572-6bad-4dfd-a92c-1f5b800e87bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d60ca48fd1b4a4ab4261ad1dbd6c8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:11:39.793434 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c5572-6bad-4dfd-a92c-1f5b800e87bb service cinder] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:11:39.793820 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c5572-6bad-4dfd-a92c-1f5b800e87bb service cinder] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:11:39.794190 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c5572-6bad-4dfd-a92c-1f5b800e87bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:11:39.805822 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97c5572-6bad-4dfd-a92c-1f5b800e87bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:11:39.807534 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97c5572-6bad-4dfd-a92c-1f5b800e87bb service cinder] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:11:39.819711 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 571/1162] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:11:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:11:49.163592 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=33 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:11:49.814117 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=5 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:12:57.470123 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b99bf7-f005-45f9-8270-b74f44f33cb6 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:12:57.470779 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b99bf7-f005-45f9-8270-b74f44f33cb6 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:12:57.470779 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b99bf7-f005-45f9-8270-b74f44f33cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:12:57.493659 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-07b99bf7-f005-45f9-8270-b74f44f33cb6 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:12:57.494898 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-07b99bf7-f005-45f9-8270-b74f44f33cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:12:57.503911 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 592/1163] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 24 04:12:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:12:57.506238 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3d1ea-b8ab-4290-bddb-4c656e2603d0 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:12:57.506758 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3d1ea-b8ab-4290-bddb-4c656e2603d0 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:12:57.506858 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3d1ea-b8ab-4290-bddb-4c656e2603d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:12:57.512120 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66098b05-8ab0-42ef-bba3-6250f34aeba8 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:12:57.512445 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66098b05-8ab0-42ef-bba3-6250f34aeba8 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:12:57.512692 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66098b05-8ab0-42ef-bba3-6250f34aeba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:12:57.527316 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-06a3d1ea-b8ab-4290-bddb-4c656e2603d0 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:12:57.528564 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-06a3d1ea-b8ab-4290-bddb-4c656e2603d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:12:57.537235 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 572/1164] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 24 04:12:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:12:57.537981 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-66098b05-8ab0-42ef-bba3-6250f34aeba8 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:12:57.539181 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-66098b05-8ab0-42ef-bba3-6250f34aeba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:12:57.545578 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f160fe2-45da-4bb8-9120-b79b1c612bfe None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:12:57.545870 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f160fe2-45da-4bb8-9120-b79b1c612bfe None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:12:57.546142 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f160fe2-45da-4bb8-9120-b79b1c612bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:12:57.547022 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 593/1165] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 24 04:12:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:12:57.551512 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66098b05-8ab0-42ef-bba3-6250f34aeba8 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:12:57.560778 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66098b05-8ab0-42ef-bba3-6250f34aeba8 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:12:57.565302 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c955ad-126b-4de1-99fb-7bf9225caca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d781cc0590648468fbe68aed993b0f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:12:57.566260 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c955ad-126b-4de1-99fb-7bf9225caca6 admin admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:12:57.566554 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c955ad-126b-4de1-99fb-7bf9225caca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:12:57.566831 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c955ad-126b-4de1-99fb-7bf9225caca6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:12:57.567498 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c955ad-126b-4de1-99fb-7bf9225caca6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:12:57.567806 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c955ad-126b-4de1-99fb-7bf9225caca6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:12:57.569393 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c955ad-126b-4de1-99fb-7bf9225caca6 admin admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:12:57.571224 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-7f160fe2-45da-4bb8-9120-b79b1c612bfe None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:12:57.572476 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-7f160fe2-45da-4bb8-9120-b79b1c612bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:12:57.580627 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 573/1166] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 24 04:12:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:12:57.586811 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 594/1167] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 24 04:12:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:12:57.586975 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f160fe2-45da-4bb8-9120-b79b1c612bfe None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:12:57.589727 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c955ad-126b-4de1-99fb-7bf9225caca6 admin admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:12:57.594843 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f160fe2-45da-4bb8-9120-b79b1c612bfe None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:12:57.599566 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33eaad-da1e-4bd3-a6f6-8c8ed1fbd342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d781cc0590648468fbe68aed993b0f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:12:57.599744 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c955ad-126b-4de1-99fb-7bf9225caca6 admin admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:12:57.600163 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33eaad-da1e-4bd3-a6f6-8c8ed1fbd342 admin admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:12:57.600442 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33eaad-da1e-4bd3-a6f6-8c8ed1fbd342 admin admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:12:57.600712 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33eaad-da1e-4bd3-a6f6-8c8ed1fbd342 admin admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:12:57.601355 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a33eaad-da1e-4bd3-a6f6-8c8ed1fbd342 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:12:57.601654 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a33eaad-da1e-4bd3-a6f6-8c8ed1fbd342 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:12:57.602681 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: WARNING py.warnings [None req-4a33eaad-da1e-4bd3-a6f6-8c8ed1fbd342 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:12:57.602681 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: warnings.warn(msg) Aug 24 04:12:57.602681 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: Aug 24 04:12:57.603599 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a33eaad-da1e-4bd3-a6f6-8c8ed1fbd342 admin admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:12:57.604476 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94241b1-5c0f-417c-a02e-73d542f6b991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d781cc0590648468fbe68aed993b0f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:12:57.605072 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94241b1-5c0f-417c-a02e-73d542f6b991 admin admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:12:57.605351 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94241b1-5c0f-417c-a02e-73d542f6b991 admin admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:12:57.605624 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94241b1-5c0f-417c-a02e-73d542f6b991 admin admin] PATH_INFO: `/v3/projects` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:12:57.606291 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94241b1-5c0f-417c-a02e-73d542f6b991 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:12:57.607341 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: WARNING py.warnings [None req-a94241b1-5c0f-417c-a02e-73d542f6b991 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:12:57.607341 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: warnings.warn(msg) Aug 24 04:12:57.607341 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: Aug 24 04:12:57.608546 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94241b1-5c0f-417c-a02e-73d542f6b991 admin admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:12:57.619376 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 574/1168] 10.222.0.15 () {58 vars in 1153 bytes} [Wed Aug 24 04:12:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:12:57.624607 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33eaad-da1e-4bd3-a6f6-8c8ed1fbd342 admin admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:12:57.634480 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33eaad-da1e-4bd3-a6f6-8c8ed1fbd342 admin admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:12:57.640215 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a676d7-e560-4150-ba5e-05230f288329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d781cc0590648468fbe68aed993b0f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:12:57.640802 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a676d7-e560-4150-ba5e-05230f288329 admin admin] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:12:57.641177 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a676d7-e560-4150-ba5e-05230f288329 admin admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:12:57.641371 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a676d7-e560-4150-ba5e-05230f288329 admin admin] PATH_INFO: `/v3/projects` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:12:57.642002 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a676d7-e560-4150-ba5e-05230f288329 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:12:57.644191 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a676d7-e560-4150-ba5e-05230f288329 admin admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:12:57.649773 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 595/1169] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 24 04:12:57 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:12:57.654235 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94241b1-5c0f-417c-a02e-73d542f6b991 admin admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:12:57.673595 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 575/1170] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 24 04:12:57 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:12:57.677856 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a676d7-e560-4150-ba5e-05230f288329 admin admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:12:57.719683 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94241b1-5c0f-417c-a02e-73d542f6b991 admin admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:12:57.741126 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a676d7-e560-4150-ba5e-05230f288329 admin admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:12:57.745886 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0006f-923d-4d77-84d5-6a733f3c8632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d781cc0590648468fbe68aed993b0f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:12:57.746525 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0006f-923d-4d77-84d5-6a733f3c8632 admin admin] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:12:57.746790 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0006f-923d-4d77-84d5-6a733f3c8632 admin admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:12:57.747061 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0006f-923d-4d77-84d5-6a733f3c8632 admin admin] PATH_INFO: `/v3/users` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:12:57.747726 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae0006f-923d-4d77-84d5-6a733f3c8632 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:12:57.748756 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: WARNING py.warnings [None req-8ae0006f-923d-4d77-84d5-6a733f3c8632 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:12:57.748756 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: warnings.warn(msg) Aug 24 04:12:57.748756 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: Aug 24 04:12:57.749981 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae0006f-923d-4d77-84d5-6a733f3c8632 admin admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:12:57.779968 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 576/1171] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 24 04:12:57 2022] POST /identity/v3/users => generated 291 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:12:57.781284 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d215c-5b17-4096-b204-f674d42d1549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d781cc0590648468fbe68aed993b0f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:12:57.781905 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d215c-5b17-4096-b204-f674d42d1549 admin admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:12:57.782186 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d215c-5b17-4096-b204-f674d42d1549 admin admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:12:57.782456 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d215c-5b17-4096-b204-f674d42d1549 admin admin] PATH_INFO: `/v3/users` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:12:57.783074 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d215c-5b17-4096-b204-f674d42d1549 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:12:57.784187 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0006f-923d-4d77-84d5-6a733f3c8632 admin admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:12:57.785038 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d215c-5b17-4096-b204-f674d42d1549 admin admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:12:57.794528 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0006f-923d-4d77-84d5-6a733f3c8632 admin admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:12:57.801638 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1948c-563c-43c8-ac49-29b3bb8458de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d781cc0590648468fbe68aed993b0f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:12:57.802321 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1948c-563c-43c8-ac49-29b3bb8458de admin admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:12:57.802538 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1948c-563c-43c8-ac49-29b3bb8458de admin admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:12:57.802811 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1948c-563c-43c8-ac49-29b3bb8458de admin admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:12:57.803483 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1948c-563c-43c8-ac49-29b3bb8458de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:12:57.805307 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1948c-563c-43c8-ac49-29b3bb8458de admin admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:12:57.812921 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 596/1172] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 24 04:12:57 2022] POST /identity/v3/users => generated 290 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:12:57.814264 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d215c-5b17-4096-b204-f674d42d1549 admin admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:12:57.816650 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 577/1173] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 24 04:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:12:57.820666 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1948c-563c-43c8-ac49-29b3bb8458de admin admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:12:57.825009 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d215c-5b17-4096-b204-f674d42d1549 admin admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:12:57.830238 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8d961-aec2-439c-a6ed-53ab05ed9194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d781cc0590648468fbe68aed993b0f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:12:57.830892 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1948c-563c-43c8-ac49-29b3bb8458de admin admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:12:57.831077 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8d961-aec2-439c-a6ed-53ab05ed9194 admin admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:12:57.831486 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8d961-aec2-439c-a6ed-53ab05ed9194 admin admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:12:57.831912 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8d961-aec2-439c-a6ed-53ab05ed9194 admin admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:12:57.833135 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a8d961-aec2-439c-a6ed-53ab05ed9194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:12:57.835692 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a8d961-aec2-439c-a6ed-53ab05ed9194 admin admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:12:57.835928 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3a819-031a-40d0-8430-037afb467e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d781cc0590648468fbe68aed993b0f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:12:57.836545 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3a819-031a-40d0-8430-037afb467e0f admin admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:12:57.836822 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3a819-031a-40d0-8430-037afb467e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:12:57.837097 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3a819-031a-40d0-8430-037afb467e0f admin admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:12:57.837762 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a3a819-031a-40d0-8430-037afb467e0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:12:57.839397 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a3a819-031a-40d0-8430-037afb467e0f admin admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:12:57.846570 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 597/1174] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 24 04:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:12:57.850508 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8d961-aec2-439c-a6ed-53ab05ed9194 admin admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:12:57.851378 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 578/1175] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 24 04:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:12:57.854894 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3a819-031a-40d0-8430-037afb467e0f admin admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:12:57.861130 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8d961-aec2-439c-a6ed-53ab05ed9194 admin admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:12:57.864729 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3a819-031a-40d0-8430-037afb467e0f admin admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:12:57.867320 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c4428-2bb0-45cf-ab37-e2cd3ebf2bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d781cc0590648468fbe68aed993b0f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:12:57.868073 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c4428-2bb0-45cf-ab37-e2cd3ebf2bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:12:57.868408 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c4428-2bb0-45cf-ab37-e2cd3ebf2bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:12:57.868788 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c4428-2bb0-45cf-ab37-e2cd3ebf2bb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:12:57.869439 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c4428-2bb0-45cf-ab37-e2cd3ebf2bb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:12:57.869554 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5b66f-0db9-48e4-aab1-af978b7d9216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d781cc0590648468fbe68aed993b0f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:12:57.870089 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5b66f-0db9-48e4-aab1-af978b7d9216 admin admin] REQUEST_METHOD: `PUT` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:12:57.870361 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5b66f-0db9-48e4-aab1-af978b7d9216 admin admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:12:57.870631 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5b66f-0db9-48e4-aab1-af978b7d9216 admin admin] PATH_INFO: `/v3/projects/e7c39e51c0174f8d9fe9964a40aeba2b/users/67fbe8bf4a4d442bae61628be7f8c8e8/roles/5d03284e31284f60bcc99e4843279067` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:12:57.871581 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c4428-2bb0-45cf-ab37-e2cd3ebf2bb4 admin admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:12:57.884644 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 598/1176] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 24 04:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:12:57.890157 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c4428-2bb0-45cf-ab37-e2cd3ebf2bb4 admin admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:12:57.891848 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa5b66f-0db9-48e4-aab1-af978b7d9216 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7c39e51c0174f8d9fe9964a40aeba2b, user_id=67fbe8bf4a4d442bae61628be7f8c8e8, role_id=5d03284e31284f60bcc99e4843279067)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:12:57.894584 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa5b66f-0db9-48e4-aab1-af978b7d9216 admin admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:12:57.901268 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c4428-2bb0-45cf-ab37-e2cd3ebf2bb4 admin admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:12:57.905967 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaad5f6-01e1-4422-9528-27157ea54d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d781cc0590648468fbe68aed993b0f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:12:57.906606 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaad5f6-01e1-4422-9528-27157ea54d35 admin admin] REQUEST_METHOD: `PUT` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:12:57.906910 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaad5f6-01e1-4422-9528-27157ea54d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:12:57.907166 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaad5f6-01e1-4422-9528-27157ea54d35 admin admin] PATH_INFO: `/v3/projects/4ce50eef9241499eb5528e8b2778ee22/users/3ddbc5146c654e9eb59d57dcee789f4e/roles/5d03284e31284f60bcc99e4843279067` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:12:57.909068 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 579/1177] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 24 04:12:57 2022] PUT /identity/v3/projects/e7c39e51c0174f8d9fe9964a40aeba2b/users/67fbe8bf4a4d442bae61628be7f8c8e8/roles/5d03284e31284f60bcc99e4843279067 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:12:57.914987 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f51d2-4f22-44ce-b8ee-f67ae288bf68 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:12:57.916795 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f51d2-4f22-44ce-b8ee-f67ae288bf68 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:12:57.917105 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f51d2-4f22-44ce-b8ee-f67ae288bf68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:12:57.926167 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaad5f6-01e1-4422-9528-27157ea54d35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ce50eef9241499eb5528e8b2778ee22, user_id=3ddbc5146c654e9eb59d57dcee789f4e, role_id=5d03284e31284f60bcc99e4843279067)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:12:57.927212 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: WARNING py.warnings [None req-dfaad5f6-01e1-4422-9528-27157ea54d35 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:12:57.927212 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: warnings.warn(msg) Aug 24 04:12:57.927212 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: Aug 24 04:12:57.929636 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaad5f6-01e1-4422-9528-27157ea54d35 admin admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:12:57.932196 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:12:57.938077 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-da9f51d2-4f22-44ce-b8ee-f67ae288bf68 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:12:57.939327 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-da9f51d2-4f22-44ce-b8ee-f67ae288bf68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:12:57.946098 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 599/1178] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 24 04:12:57 2022] PUT /identity/v3/projects/4ce50eef9241499eb5528e8b2778ee22/users/3ddbc5146c654e9eb59d57dcee789f4e/roles/5d03284e31284f60bcc99e4843279067 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:12:57.951594 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043a873-7167-49ba-a60a-eadce00a0ab2 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:12:57.951892 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043a873-7167-49ba-a60a-eadce00a0ab2 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:12:57.952164 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043a873-7167-49ba-a60a-eadce00a0ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:12:57.971109 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-4043a873-7167-49ba-a60a-eadce00a0ab2 None None] MFA Rules not processed for user `c414fa8ffb744c22a2619f1ccb5b8577`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:12:57.972408 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-4043a873-7167-49ba-a60a-eadce00a0ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:12:57.990876 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:12:58.003166 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 580/1179] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 24 04:12:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:12:58.013783 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f51d2-4f22-44ce-b8ee-f67ae288bf68 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:12:58.041629 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 600/1180] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 24 04:12:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:12:58.053818 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043a873-7167-49ba-a60a-eadce00a0ab2 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:12:58.080010 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f51d2-4f22-44ce-b8ee-f67ae288bf68 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:12:58.083794 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa09396f-192b-49a9-922b-db5e21b1ea20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62f90d6440048e58cf530701a979e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:12:58.084407 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09396f-192b-49a9-922b-db5e21b1ea20 service neutron] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:12:58.084681 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09396f-192b-49a9-922b-db5e21b1ea20 service neutron] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:12:58.084951 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa09396f-192b-49a9-922b-db5e21b1ea20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:12:58.093997 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa09396f-192b-49a9-922b-db5e21b1ea20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:12:58.095494 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa09396f-192b-49a9-922b-db5e21b1ea20 service neutron] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:12:58.105588 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 581/1181] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:12:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:12:58.113347 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043a873-7167-49ba-a60a-eadce00a0ab2 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:12:58.116934 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e432b3-e5ec-405e-87e4-93bf9d39e201 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62f90d6440048e58cf530701a979e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:12:58.117542 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e432b3-e5ec-405e-87e4-93bf9d39e201 service neutron] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:12:58.117814 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e432b3-e5ec-405e-87e4-93bf9d39e201 service neutron] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:12:58.118078 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e432b3-e5ec-405e-87e4-93bf9d39e201 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:12:58.127448 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e432b3-e5ec-405e-87e4-93bf9d39e201 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:12:58.129193 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e432b3-e5ec-405e-87e4-93bf9d39e201 service neutron] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:12:58.140328 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 601/1182] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:12:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:13:03.386480 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8c699-dffe-494b-8aad-87cdce974d09 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:13:03.391615 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8c699-dffe-494b-8aad-87cdce974d09 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:13:03.396294 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8c699-dffe-494b-8aad-87cdce974d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:13:03.460390 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-bfc8c699-dffe-494b-8aad-87cdce974d09 None None] MFA Rules not processed for user `67fbe8bf4a4d442bae61628be7f8c8e8`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:13:03.461841 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-bfc8c699-dffe-494b-8aad-87cdce974d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:13:03.585249 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f2038-7bda-4d4b-8240-01d37cafa12e None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:13:03.585802 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f2038-7bda-4d4b-8240-01d37cafa12e None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:13:03.585802 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f2038-7bda-4d4b-8240-01d37cafa12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:13:03.604787 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 582/1183] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 24 04:13:03 2022] POST /identity/v3/auth/tokens => generated 2818 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:13:03.606184 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc8c699-dffe-494b-8aad-87cdce974d09 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:13:03.623235 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc8c699-dffe-494b-8aad-87cdce974d09 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:13:03.627837 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-da5f2038-7bda-4d4b-8240-01d37cafa12e None None] MFA Rules not processed for user `3ddbc5146c654e9eb59d57dcee789f4e`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:13:03.629759 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-da5f2038-7bda-4d4b-8240-01d37cafa12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:13:03.630599 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9af5de-1d11-441f-8129-9374893be023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d781cc0590648468fbe68aed993b0f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:13:03.631261 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9af5de-1d11-441f-8129-9374893be023 admin admin] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:13:03.631576 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9af5de-1d11-441f-8129-9374893be023 admin admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:13:03.631850 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9af5de-1d11-441f-8129-9374893be023 admin admin] PATH_INFO: `/v3/projects` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:13:03.632654 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9af5de-1d11-441f-8129-9374893be023 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:13:03.634594 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9af5de-1d11-441f-8129-9374893be023 admin admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:13:03.697907 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 583/1184] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 24 04:13:03 2022] POST /identity/v3/projects => generated 383 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:13:03.702145 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9af5de-1d11-441f-8129-9374893be023 admin admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:13:03.735384 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 602/1185] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 24 04:13:03 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 24 04:13:03.739949 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f2038-7bda-4d4b-8240-01d37cafa12e None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:13:03.759029 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f2038-7bda-4d4b-8240-01d37cafa12e None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:13:03.807228 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:13:03.844653 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9af5de-1d11-441f-8129-9374893be023 admin admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:13:03.857995 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94332b-63c4-4820-a02b-b541d7c71b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d781cc0590648468fbe68aed993b0f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:13:03.858402 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94332b-63c4-4820-a02b-b541d7c71b84 admin admin] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:13:03.858684 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94332b-63c4-4820-a02b-b541d7c71b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:13:03.858962 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94332b-63c4-4820-a02b-b541d7c71b84 admin admin] PATH_INFO: `/v3/users` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:13:03.859650 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba94332b-63c4-4820-a02b-b541d7c71b84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:13:03.861644 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba94332b-63c4-4820-a02b-b541d7c71b84 admin admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:13:03.866383 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a575c61-4779-4c3d-83e7-038e04f652ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d781cc0590648468fbe68aed993b0f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:13:03.867115 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a575c61-4779-4c3d-83e7-038e04f652ec admin admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:13:03.867529 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a575c61-4779-4c3d-83e7-038e04f652ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:13:03.868340 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a575c61-4779-4c3d-83e7-038e04f652ec admin admin] PATH_INFO: `/v3/projects` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:13:03.868729 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a575c61-4779-4c3d-83e7-038e04f652ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:13:03.871871 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a575c61-4779-4c3d-83e7-038e04f652ec admin admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:13:03.874839 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:13:03.903654 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 584/1186] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 24 04:13:03 2022] POST /identity/v3/users => generated 298 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:13:03.905369 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94332b-63c4-4820-a02b-b541d7c71b84 admin admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:13:03.922334 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94332b-63c4-4820-a02b-b541d7c71b84 admin admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:13:03.931051 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 603/1187] 10.222.0.15 () {60 vars in 1153 bytes} [Wed Aug 24 04:13:03 2022] POST /identity/v3/projects => generated 379 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:13:03.934323 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab699e-a7a0-4a52-9478-f5d7cf9cb01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d781cc0590648468fbe68aed993b0f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:13:03.934323 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab699e-a7a0-4a52-9478-f5d7cf9cb01b admin admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:13:03.934323 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab699e-a7a0-4a52-9478-f5d7cf9cb01b admin admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:13:03.934323 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab699e-a7a0-4a52-9478-f5d7cf9cb01b admin admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:13:03.934672 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab699e-a7a0-4a52-9478-f5d7cf9cb01b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:13:03.935873 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab699e-a7a0-4a52-9478-f5d7cf9cb01b admin admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:13:03.936575 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a575c61-4779-4c3d-83e7-038e04f652ec admin admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:13:03.953728 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 585/1188] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 24 04:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:13:03.958577 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab699e-a7a0-4a52-9478-f5d7cf9cb01b admin admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:13:03.981773 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab699e-a7a0-4a52-9478-f5d7cf9cb01b admin admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:13:04.081279 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a575c61-4779-4c3d-83e7-038e04f652ec admin admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:13:04.081483 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741dbd7-cadb-436c-bcd7-773657ea0a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d781cc0590648468fbe68aed993b0f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:13:04.082181 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741dbd7-cadb-436c-bcd7-773657ea0a10 admin admin] REQUEST_METHOD: `PUT` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:13:04.082459 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741dbd7-cadb-436c-bcd7-773657ea0a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:13:04.082726 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741dbd7-cadb-436c-bcd7-773657ea0a10 admin admin] PATH_INFO: `/v3/projects/9a9ad55fe6b24c7eaa3a40953a2a5e2e/users/c34baefa97b4409f9e8a0c9b78ffa4db/roles/df6a8bb215d54f71a0b6988a9c01f5e4` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:13:04.089796 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ccbdc-cf40-425d-8c1c-543cc4295fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d781cc0590648468fbe68aed993b0f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:13:04.090881 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ccbdc-cf40-425d-8c1c-543cc4295fb0 admin admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:13:04.091163 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ccbdc-cf40-425d-8c1c-543cc4295fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:13:04.091469 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ccbdc-cf40-425d-8c1c-543cc4295fb0 admin admin] PATH_INFO: `/v3/users` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:13:04.092106 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ccbdc-cf40-425d-8c1c-543cc4295fb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:13:04.095278 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ccbdc-cf40-425d-8c1c-543cc4295fb0 admin admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:13:04.101573 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0741dbd7-cadb-436c-bcd7-773657ea0a10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a9ad55fe6b24c7eaa3a40953a2a5e2e, user_id=c34baefa97b4409f9e8a0c9b78ffa4db, role_id=df6a8bb215d54f71a0b6988a9c01f5e4)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:13:04.105839 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0741dbd7-cadb-436c-bcd7-773657ea0a10 admin admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:13:04.131320 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 604/1189] 10.222.0.15 () {60 vars in 1144 bytes} [Wed Aug 24 04:13:03 2022] POST /identity/v3/users => generated 296 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:13:04.139850 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ccbdc-cf40-425d-8c1c-543cc4295fb0 admin admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:13:04.150158 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 586/1190] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 24 04:13:03 2022] PUT /identity/v3/projects/9a9ad55fe6b24c7eaa3a40953a2a5e2e/users/c34baefa97b4409f9e8a0c9b78ffa4db/roles/df6a8bb215d54f71a0b6988a9c01f5e4 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:13:04.160316 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741dbd7-cadb-436c-bcd7-773657ea0a10 admin admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:13:04.172223 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ccbdc-cf40-425d-8c1c-543cc4295fb0 admin admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:13:04.240266 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93d2ac-a7f3-4780-9270-b2d24ea84e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d781cc0590648468fbe68aed993b0f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:13:04.240810 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93d2ac-a7f3-4780-9270-b2d24ea84e38 admin admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:13:04.241675 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93d2ac-a7f3-4780-9270-b2d24ea84e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:13:04.241937 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93d2ac-a7f3-4780-9270-b2d24ea84e38 admin admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:13:04.242663 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e93d2ac-a7f3-4780-9270-b2d24ea84e38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:13:04.244631 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e93d2ac-a7f3-4780-9270-b2d24ea84e38 admin admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:13:04.251429 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741dbd7-cadb-436c-bcd7-773657ea0a10 admin admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:13:04.257777 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e995e-b214-44fd-9d8c-4383f77839b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d781cc0590648468fbe68aed993b0f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:13:04.258771 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e995e-b214-44fd-9d8c-4383f77839b3 admin admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:13:04.261127 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 605/1191] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 24 04:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:13:04.263423 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e995e-b214-44fd-9d8c-4383f77839b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:13:04.263722 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e995e-b214-44fd-9d8c-4383f77839b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:13:04.264513 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23e995e-b214-44fd-9d8c-4383f77839b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:13:04.266113 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93d2ac-a7f3-4780-9270-b2d24ea84e38 admin admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:13:04.266330 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23e995e-b214-44fd-9d8c-4383f77839b3 admin admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:13:04.280381 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93d2ac-a7f3-4780-9270-b2d24ea84e38 admin admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:13:04.287887 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e5a40-7434-40d9-b44f-972aac3cd00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d781cc0590648468fbe68aed993b0f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:13:04.287887 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e5a40-7434-40d9-b44f-972aac3cd00b admin admin] REQUEST_METHOD: `PUT` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:13:04.287887 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e5a40-7434-40d9-b44f-972aac3cd00b admin admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:13:04.287887 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e5a40-7434-40d9-b44f-972aac3cd00b admin admin] PATH_INFO: `/v3/projects/f8557a7fa311447bba15d420a00d3546/users/105cb9fdad5c48eeb4eb8eefa47c7de2/roles/df6a8bb215d54f71a0b6988a9c01f5e4` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:13:04.290193 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 587/1192] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 24 04:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:13:04.292169 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e995e-b214-44fd-9d8c-4383f77839b3 admin admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:13:04.326955 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e995e-b214-44fd-9d8c-4383f77839b3 admin admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:13:04.330384 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e5a40-7434-40d9-b44f-972aac3cd00b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8557a7fa311447bba15d420a00d3546, user_id=105cb9fdad5c48eeb4eb8eefa47c7de2, role_id=df6a8bb215d54f71a0b6988a9c01f5e4)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:13:04.333657 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e5a40-7434-40d9-b44f-972aac3cd00b admin admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:13:04.336205 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc07a1-3f31-45fe-9a70-7fadf6695a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d781cc0590648468fbe68aed993b0f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:13:04.337705 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc07a1-3f31-45fe-9a70-7fadf6695a04 admin admin] REQUEST_METHOD: `PUT` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:13:04.338271 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc07a1-3f31-45fe-9a70-7fadf6695a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:13:04.338651 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc07a1-3f31-45fe-9a70-7fadf6695a04 admin admin] PATH_INFO: `/v3/projects/9a9ad55fe6b24c7eaa3a40953a2a5e2e/users/c34baefa97b4409f9e8a0c9b78ffa4db/roles/df6a8bb215d54f71a0b6988a9c01f5e4` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:13:04.344300 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bc07a1-3f31-45fe-9a70-7fadf6695a04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a9ad55fe6b24c7eaa3a40953a2a5e2e, user_id=c34baefa97b4409f9e8a0c9b78ffa4db, role_id=df6a8bb215d54f71a0b6988a9c01f5e4)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:13:04.347600 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bc07a1-3f31-45fe-9a70-7fadf6695a04 admin admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:13:04.355457 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 606/1193] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 24 04:13:04 2022] PUT /identity/v3/projects/f8557a7fa311447bba15d420a00d3546/users/105cb9fdad5c48eeb4eb8eefa47c7de2/roles/df6a8bb215d54f71a0b6988a9c01f5e4 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:13:04.358591 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e5a40-7434-40d9-b44f-972aac3cd00b admin admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:13:04.361684 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 588/1194] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 24 04:13:04 2022] PUT /identity/v3/projects/9a9ad55fe6b24c7eaa3a40953a2a5e2e/users/c34baefa97b4409f9e8a0c9b78ffa4db/roles/df6a8bb215d54f71a0b6988a9c01f5e4 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:13:04.375297 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:13:04.456151 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e5a40-7434-40d9-b44f-972aac3cd00b admin admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:13:04.558532 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849d53d-8c73-4bea-b71f-69d5c7117c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d781cc0590648468fbe68aed993b0f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:13:04.559459 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849d53d-8c73-4bea-b71f-69d5c7117c25 admin admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:13:04.559870 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849d53d-8c73-4bea-b71f-69d5c7117c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:13:04.560257 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849d53d-8c73-4bea-b71f-69d5c7117c25 admin admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:13:04.561212 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c849d53d-8c73-4bea-b71f-69d5c7117c25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:13:04.563745 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c849d53d-8c73-4bea-b71f-69d5c7117c25 admin admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:13:04.582822 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 607/1195] 10.222.0.15 () {58 vars in 1122 bytes} [Wed Aug 24 04:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:13:04.588773 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc07a1-3f31-45fe-9a70-7fadf6695a04 admin admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:13:04.614393 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc07a1-3f31-45fe-9a70-7fadf6695a04 admin admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:13:04.629989 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb661fe-3282-43a5-87c5-2d7ebac2d62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d781cc0590648468fbe68aed993b0f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:13:04.645015 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb661fe-3282-43a5-87c5-2d7ebac2d62f admin admin] REQUEST_METHOD: `PUT` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:13:04.646107 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb661fe-3282-43a5-87c5-2d7ebac2d62f admin admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:13:04.646455 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb661fe-3282-43a5-87c5-2d7ebac2d62f admin admin] PATH_INFO: `/v3/projects/f8557a7fa311447bba15d420a00d3546/users/105cb9fdad5c48eeb4eb8eefa47c7de2/roles/df6a8bb215d54f71a0b6988a9c01f5e4` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:13:04.649128 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb661fe-3282-43a5-87c5-2d7ebac2d62f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8557a7fa311447bba15d420a00d3546, user_id=105cb9fdad5c48eeb4eb8eefa47c7de2, role_id=df6a8bb215d54f71a0b6988a9c01f5e4)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:13:04.652549 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb661fe-3282-43a5-87c5-2d7ebac2d62f admin admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:13:04.693362 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 589/1196] 10.222.0.15 () {60 vars in 1483 bytes} [Wed Aug 24 04:13:04 2022] PUT /identity/v3/projects/f8557a7fa311447bba15d420a00d3546/users/105cb9fdad5c48eeb4eb8eefa47c7de2/roles/df6a8bb215d54f71a0b6988a9c01f5e4 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:13:11.748176 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b907d8-31d7-49ce-b07c-3a6adc7ce244 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:13:11.748795 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b907d8-31d7-49ce-b07c-3a6adc7ce244 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:13:11.749198 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b907d8-31d7-49ce-b07c-3a6adc7ce244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:13:11.799133 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-d0b907d8-31d7-49ce-b07c-3a6adc7ce244 None None] MFA Rules not processed for user `c34baefa97b4409f9e8a0c9b78ffa4db`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:13:11.800781 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-d0b907d8-31d7-49ce-b07c-3a6adc7ce244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:13:11.970151 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 608/1197] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 24 04:13:11 2022] POST /identity/v3/auth/tokens => generated 2887 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:13:11.989163 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb661fe-3282-43a5-87c5-2d7ebac2d62f admin admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:13:11.991358 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-eeb661fe-3282-43a5-87c5-2d7ebac2d62f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:13:12.102611 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:13:12.168098 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb661fe-3282-43a5-87c5-2d7ebac2d62f admin admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:13:12.178264 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb8777-c7cf-40ea-af27-5c57a4152191 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7da73e8a2c7a4c5aafd1d3fbea603970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:13:12.178956 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb8777-c7cf-40ea-af27-5c57a4152191 service glance] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:13:12.179279 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb8777-c7cf-40ea-af27-5c57a4152191 service glance] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:13:12.179655 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb8777-c7cf-40ea-af27-5c57a4152191 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:13:12.305834 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedb8777-c7cf-40ea-af27-5c57a4152191 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:13:12.308307 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedb8777-c7cf-40ea-af27-5c57a4152191 service glance] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:13:12.321336 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 590/1198] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:13:11 2022] GET /identity/v3/auth/tokens => generated 2818 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:13:12.598644 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b54ea-5ac6-4288-8cea-1133fb1c9f94 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:13:12.598644 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b54ea-5ac6-4288-8cea-1133fb1c9f94 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:13:12.598644 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b54ea-5ac6-4288-8cea-1133fb1c9f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:13:12.675651 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-9a0b54ea-5ac6-4288-8cea-1133fb1c9f94 None None] MFA Rules not processed for user `105cb9fdad5c48eeb4eb8eefa47c7de2`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:13:12.679124 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-9a0b54ea-5ac6-4288-8cea-1133fb1c9f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:13:12.742047 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:13:12.850768 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 609/1199] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 24 04:13:12 2022] POST /identity/v3/auth/tokens => generated 2883 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:13:12.870112 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb8777-c7cf-40ea-af27-5c57a4152191 service glance] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:13:12.885610 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb8777-c7cf-40ea-af27-5c57a4152191 service glance] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:13:12.898883 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97628cd-6738-4b64-a5ed-815cc4a3d9f6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7da73e8a2c7a4c5aafd1d3fbea603970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:13:12.899593 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97628cd-6738-4b64-a5ed-815cc4a3d9f6 service glance] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:13:12.899918 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97628cd-6738-4b64-a5ed-815cc4a3d9f6 service glance] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:13:12.900114 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97628cd-6738-4b64-a5ed-815cc4a3d9f6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:13:13.008809 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97628cd-6738-4b64-a5ed-815cc4a3d9f6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:13:13.010883 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97628cd-6738-4b64-a5ed-815cc4a3d9f6 service glance] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:13:13.023258 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 591/1200] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:13:12 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:13:22.624042 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee775fda-b769-4b94-b354-9e07a0cceba6 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:13:22.624737 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee775fda-b769-4b94-b354-9e07a0cceba6 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:13:22.624848 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee775fda-b769-4b94-b354-9e07a0cceba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:13:22.653510 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-ee775fda-b769-4b94-b354-9e07a0cceba6 None None] MFA Rules not processed for user `67fbe8bf4a4d442bae61628be7f8c8e8`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:13:22.655486 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-ee775fda-b769-4b94-b354-9e07a0cceba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:13:22.667245 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 610/1201] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 24 04:13:22 2022] POST /identity/v3/auth/tokens => generated 2818 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:13:23.024740 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=64 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:13:23.114293 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93cc70-2745-4675-a1d6-6d868fa23809 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:13:23.114808 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93cc70-2745-4675-a1d6-6d868fa23809 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:13:23.115315 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93cc70-2745-4675-a1d6-6d868fa23809 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:13:23.118637 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 592/1202] 10.222.0.15 () {54 vars in 962 bytes} [Wed Aug 24 04:13:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:13:23.125109 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2689ac-b1e6-42c8-970d-51d579f530f4 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:13:23.125592 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2689ac-b1e6-42c8-970d-51d579f530f4 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:13:23.125955 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2689ac-b1e6-42c8-970d-51d579f530f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:13:23.198513 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-8e2689ac-b1e6-42c8-970d-51d579f530f4 None None] MFA Rules not processed for user `3796b1549762419686cb3b00af1a963e`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:13:23.199063 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-8e2689ac-b1e6-42c8-970d-51d579f530f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:13:23.350712 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 611/1203] 10.222.0.15 () {58 vars in 1059 bytes} [Wed Aug 24 04:13:23 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:13:23.356956 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63d4b0-1348-4822-9118-fcc57fdb5670 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:13:23.357237 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63d4b0-1348-4822-9118-fcc57fdb5670 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:13:23.357528 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63d4b0-1348-4822-9118-fcc57fdb5670 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:13:23.359183 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 593/1204] 10.222.0.15 () {54 vars in 912 bytes} [Wed Aug 24 04:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:13:23.366919 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d2826-78ba-493d-92a6-b50033fbf9d5 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:13:23.367325 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d2826-78ba-493d-92a6-b50033fbf9d5 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:13:23.367521 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d2826-78ba-493d-92a6-b50033fbf9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:13:23.396072 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-0c4d2826-78ba-493d-92a6-b50033fbf9d5 None None] MFA Rules not processed for user `3796b1549762419686cb3b00af1a963e`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:13:23.397658 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-0c4d2826-78ba-493d-92a6-b50033fbf9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:13:23.408043 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 612/1205] 10.222.0.15 () {58 vars in 1009 bytes} [Wed Aug 24 04:13:23 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:13:23.422207 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63d4b0-1348-4822-9118-fcc57fdb5670 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:13:23.425032 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-1a63d4b0-1348-4822-9118-fcc57fdb5670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:13:23.447058 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63d4b0-1348-4822-9118-fcc57fdb5670 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:13:23.456974 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ce2e7-b3d7-47f3-b357-115bf50c1d39 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7da73e8a2c7a4c5aafd1d3fbea603970', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:13:23.458052 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ce2e7-b3d7-47f3-b357-115bf50c1d39 service glance] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:13:23.458753 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ce2e7-b3d7-47f3-b357-115bf50c1d39 service glance] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:13:23.459438 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ce2e7-b3d7-47f3-b357-115bf50c1d39 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:13:23.483295 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ce2e7-b3d7-47f3-b357-115bf50c1d39 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:13:23.486342 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ce2e7-b3d7-47f3-b357-115bf50c1d39 service glance] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:13:23.506978 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 594/1206] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:13:23 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:13:24.070238 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9b222-1d29-43e0-ac6a-525eea107665 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:13:24.070893 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9b222-1d29-43e0-ac6a-525eea107665 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:13:24.070893 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9b222-1d29-43e0-ac6a-525eea107665 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:13:24.072206 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 613/1207] 10.222.0.15 () {54 vars in 912 bytes} [Wed Aug 24 04:13:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:13:24.079507 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac70e4b-1b02-4630-8fd4-04d7e33df792 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:13:24.080202 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac70e4b-1b02-4630-8fd4-04d7e33df792 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:13:24.080465 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac70e4b-1b02-4630-8fd4-04d7e33df792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:13:24.111111 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-8ac70e4b-1b02-4630-8fd4-04d7e33df792 None None] MFA Rules not processed for user `e62f90d6440048e58cf530701a979e87`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:13:24.112492 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-8ac70e4b-1b02-4630-8fd4-04d7e33df792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:13:24.193772 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 595/1208] 10.222.0.15 () {58 vars in 1009 bytes} [Wed Aug 24 04:13:24 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:13:24.205528 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9b222-1d29-43e0-ac6a-525eea107665 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:13:24.221219 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9b222-1d29-43e0-ac6a-525eea107665 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:13:24.227093 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3fa44b-409a-4c25-8042-90cc672daa8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62f90d6440048e58cf530701a979e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:13:24.228255 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3fa44b-409a-4c25-8042-90cc672daa8b service neutron] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:13:24.228818 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3fa44b-409a-4c25-8042-90cc672daa8b service neutron] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:13:24.229371 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3fa44b-409a-4c25-8042-90cc672daa8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:13:24.239591 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3fa44b-409a-4c25-8042-90cc672daa8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:13:24.241327 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3fa44b-409a-4c25-8042-90cc672daa8b service neutron] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:13:24.250700 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 614/1209] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:13:24 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:13:24.975333 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645f2a3-cd1d-4db8-9293-e75036bcb81b None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:13:24.975333 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645f2a3-cd1d-4db8-9293-e75036bcb81b None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:13:24.975333 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645f2a3-cd1d-4db8-9293-e75036bcb81b None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:13:24.976801 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 596/1210] 10.222.0.15 () {54 vars in 962 bytes} [Wed Aug 24 04:13:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:13:24.999710 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72da9a-d678-4309-8a89-f2a51c03f41e None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:13:25.000377 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72da9a-d678-4309-8a89-f2a51c03f41e None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:13:25.000987 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72da9a-d678-4309-8a89-f2a51c03f41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:13:25.019880 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf2404-3623-4f15-ad41-57b9a479f58c None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:13:25.020165 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf2404-3623-4f15-ad41-57b9a479f58c None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:13:25.020619 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf2404-3623-4f15-ad41-57b9a479f58c None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:13:25.022144 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 597/1211] 10.222.0.15 () {54 vars in 961 bytes} [Wed Aug 24 04:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:13:25.030522 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382de43f-7084-446e-af88-3ccec79daa58 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:13:25.031150 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382de43f-7084-446e-af88-3ccec79daa58 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:13:25.031950 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382de43f-7084-446e-af88-3ccec79daa58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:13:25.033059 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-8e72da9a-d678-4309-8a89-f2a51c03f41e None None] MFA Rules not processed for user `3796b1549762419686cb3b00af1a963e`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:13:25.035152 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-8e72da9a-d678-4309-8a89-f2a51c03f41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:13:25.051308 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 615/1212] 10.222.0.15 () {58 vars in 1059 bytes} [Wed Aug 24 04:13:24 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:13:25.060124 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-382de43f-7084-446e-af88-3ccec79daa58 None None] MFA Rules not processed for user `a3f34384ad354405a69b3cfa242e9504`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:13:25.062803 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd8362-c455-40b9-a6a5-a7aa5973804e None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:13:25.062803 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd8362-c455-40b9-a6a5-a7aa5973804e None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:13:25.063121 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-382de43f-7084-446e-af88-3ccec79daa58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:13:25.063329 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd8362-c455-40b9-a6a5-a7aa5973804e None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:13:25.064284 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 616/1213] 10.222.0.15 () {54 vars in 912 bytes} [Wed Aug 24 04:13:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:13:25.073243 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d3c5a-adc1-4275-bad8-3ae75ef560d8 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:13:25.074427 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d3c5a-adc1-4275-bad8-3ae75ef560d8 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:13:25.074427 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d3c5a-adc1-4275-bad8-3ae75ef560d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:13:25.103370 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-057d3c5a-adc1-4275-bad8-3ae75ef560d8 None None] MFA Rules not processed for user `3796b1549762419686cb3b00af1a963e`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:13:25.104693 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-057d3c5a-adc1-4275-bad8-3ae75ef560d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:13:25.125266 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 617/1214] 10.222.0.15 () {58 vars in 1009 bytes} [Wed Aug 24 04:13:25 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:13:25.144929 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d3c5a-adc1-4275-bad8-3ae75ef560d8 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:13:25.162858 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d3c5a-adc1-4275-bad8-3ae75ef560d8 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:13:25.171731 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d22794-cc21-4878-8533-2ec23b48ad9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62f90d6440048e58cf530701a979e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:13:25.172420 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d22794-cc21-4878-8533-2ec23b48ad9b service neutron] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:13:25.172696 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d22794-cc21-4878-8533-2ec23b48ad9b service neutron] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:13:25.172968 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d22794-cc21-4878-8533-2ec23b48ad9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:13:25.186410 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 598/1215] 10.222.0.15 () {58 vars in 1058 bytes} [Wed Aug 24 04:13:25 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:13:25.195212 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382de43f-7084-446e-af88-3ccec79daa58 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:13:25.196092 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d22794-cc21-4878-8533-2ec23b48ad9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:13:25.204822 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d22794-cc21-4878-8533-2ec23b48ad9b service neutron] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:13:25.209739 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382de43f-7084-446e-af88-3ccec79daa58 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:13:25.217989 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81968c-ecc1-4fe8-9733-67e5bc3c4a4d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3f34384ad354405a69b3cfa242e9504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:13:25.219095 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81968c-ecc1-4fe8-9733-67e5bc3c4a4d service placement] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:13:25.219683 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81968c-ecc1-4fe8-9733-67e5bc3c4a4d service placement] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:13:25.220225 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81968c-ecc1-4fe8-9733-67e5bc3c4a4d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:13:25.223364 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 618/1216] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:13:25 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:13:25.223891 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-8a81968c-ecc1-4fe8-9733-67e5bc3c4a4d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:13:25.244468 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a81968c-ecc1-4fe8-9733-67e5bc3c4a4d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:13:25.246421 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a81968c-ecc1-4fe8-9733-67e5bc3c4a4d service placement] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:13:25.264905 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 599/1217] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:13:25 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:13:35.216931 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=73 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:13:35.254692 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=64 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:13:39.217840 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6bd8e0-aa6c-4a7d-aa32-e3b3a7c712bc None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:13:39.218500 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6bd8e0-aa6c-4a7d-aa32-e3b3a7c712bc None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:13:39.218500 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6bd8e0-aa6c-4a7d-aa32-e3b3a7c712bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:13:39.246041 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-9a6bd8e0-aa6c-4a7d-aa32-e3b3a7c712bc None None] MFA Rules not processed for user `e62f90d6440048e58cf530701a979e87`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:13:39.247365 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-9a6bd8e0-aa6c-4a7d-aa32-e3b3a7c712bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:13:39.254796 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 619/1218] 10.222.0.17 () {58 vars in 1015 bytes} [Wed Aug 24 04:13:39 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:13:39.270510 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81968c-ecc1-4fe8-9733-67e5bc3c4a4d service placement] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:13:39.280535 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81968c-ecc1-4fe8-9733-67e5bc3c4a4d service placement] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:13:39.284341 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd07ad-35bd-478d-bc18-127683050b10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62f90d6440048e58cf530701a979e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:13:39.284948 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd07ad-35bd-478d-bc18-127683050b10 service neutron] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:13:39.285225 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd07ad-35bd-478d-bc18-127683050b10 service neutron] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:13:39.285498 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd07ad-35bd-478d-bc18-127683050b10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:13:39.293724 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd07ad-35bd-478d-bc18-127683050b10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:13:39.295227 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd07ad-35bd-478d-bc18-127683050b10 service neutron] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:13:39.305144 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 600/1219] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:13:39 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:13:40.234201 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04119f1d-1a79-4457-8703-2b6022fd4c5f None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:13:40.234844 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04119f1d-1a79-4457-8703-2b6022fd4c5f None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:13:40.234844 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04119f1d-1a79-4457-8703-2b6022fd4c5f None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:13:40.236254 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 620/1220] 10.222.0.15 () {54 vars in 921 bytes} [Wed Aug 24 04:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:13:40.280853 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e05aac-c854-4bdd-abc9-b4801d051be8 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:13:40.281800 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e05aac-c854-4bdd-abc9-b4801d051be8 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:13:40.282060 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e05aac-c854-4bdd-abc9-b4801d051be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:13:40.311056 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-b1e05aac-c854-4bdd-abc9-b4801d051be8 None None] MFA Rules not processed for user `3796b1549762419686cb3b00af1a963e`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:13:40.312654 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-b1e05aac-c854-4bdd-abc9-b4801d051be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:13:40.324681 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 601/1221] 10.222.0.15 () {58 vars in 1018 bytes} [Wed Aug 24 04:13:40 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:13:40.358525 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04119f1d-1a79-4457-8703-2b6022fd4c5f None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:13:40.378390 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04119f1d-1a79-4457-8703-2b6022fd4c5f None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:13:40.386463 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1a6a1-0126-4239-9171-39684a76c6f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3796b1549762419686cb3b00af1a963e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:13:40.387264 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1a6a1-0126-4239-9171-39684a76c6f8 service nova] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:13:40.387777 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1a6a1-0126-4239-9171-39684a76c6f8 service nova] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:13:40.388055 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1a6a1-0126-4239-9171-39684a76c6f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:13:40.399327 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1a6a1-0126-4239-9171-39684a76c6f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:13:40.402551 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a1a6a1-0126-4239-9171-39684a76c6f8 service nova] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:13:40.419556 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 621/1222] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:13:40 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:13:48.048567 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88dfe4c-5344-4d71-aff5-af9ed15e7b9a None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:13:48.049178 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88dfe4c-5344-4d71-aff5-af9ed15e7b9a None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:13:48.049178 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88dfe4c-5344-4d71-aff5-af9ed15e7b9a None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:13:48.051028 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 602/1223] 10.222.0.15 () {54 vars in 921 bytes} [Wed Aug 24 04:13:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:13:48.074106 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1518a8-d753-494e-8439-2376861e2d32 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:13:48.074718 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1518a8-d753-494e-8439-2376861e2d32 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:13:48.075219 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1518a8-d753-494e-8439-2376861e2d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:13:48.099029 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-ec1518a8-d753-494e-8439-2376861e2d32 None None] MFA Rules not processed for user `3796b1549762419686cb3b00af1a963e`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:13:48.100420 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-ec1518a8-d753-494e-8439-2376861e2d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:13:48.113866 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 622/1224] 10.222.0.15 () {58 vars in 1018 bytes} [Wed Aug 24 04:13:48 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:13:48.133862 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88dfe4c-5344-4d71-aff5-af9ed15e7b9a None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:13:48.156063 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88dfe4c-5344-4d71-aff5-af9ed15e7b9a None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:13:48.161704 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5084fa1-35e0-4c4e-a9e4-ac1c9b8a7172 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3796b1549762419686cb3b00af1a963e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:13:48.162319 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5084fa1-35e0-4c4e-a9e4-ac1c9b8a7172 service nova] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:13:48.162596 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5084fa1-35e0-4c4e-a9e4-ac1c9b8a7172 service nova] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:13:48.162966 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5084fa1-35e0-4c4e-a9e4-ac1c9b8a7172 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:13:48.174229 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5084fa1-35e0-4c4e-a9e4-ac1c9b8a7172 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:13:48.175934 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5084fa1-35e0-4c4e-a9e4-ac1c9b8a7172 service nova] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:13:48.191234 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 603/1225] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:13:48 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:13:58.094203 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=12 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:13:58.182723 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=15 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:14:02.473486 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1518a8-d753-494e-8439-2376861e2d32 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:14:02.484031 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1518a8-d753-494e-8439-2376861e2d32 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:14:02.488093 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288534d-674c-4a40-9619-54bd4b39e8ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62f90d6440048e58cf530701a979e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:14:02.488702 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288534d-674c-4a40-9619-54bd4b39e8ee service neutron] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:14:02.488979 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288534d-674c-4a40-9619-54bd4b39e8ee service neutron] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:14:02.489250 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288534d-674c-4a40-9619-54bd4b39e8ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:14:02.498853 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6288534d-674c-4a40-9619-54bd4b39e8ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:14:02.501315 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6288534d-674c-4a40-9619-54bd4b39e8ee service neutron] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:14:02.512229 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 623/1226] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:14:02 2022] GET /identity/v3/auth/tokens => generated 2887 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:14:06.572653 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ed901-5383-4b30-8801-77d02f426dce None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:14:06.573682 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ed901-5383-4b30-8801-77d02f426dce None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:14:06.574186 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ed901-5383-4b30-8801-77d02f426dce None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:14:06.576518 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 604/1227] 10.222.0.15 () {54 vars in 921 bytes} [Wed Aug 24 04:14:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:14:06.591087 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fdf520-542a-443b-899b-f6431533c62c None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:14:06.592937 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fdf520-542a-443b-899b-f6431533c62c None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:14:06.593665 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fdf520-542a-443b-899b-f6431533c62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:14:06.645655 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-70fdf520-542a-443b-899b-f6431533c62c None None] MFA Rules not processed for user `3796b1549762419686cb3b00af1a963e`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:14:06.646925 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-70fdf520-542a-443b-899b-f6431533c62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:14:06.664077 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 624/1228] 10.222.0.15 () {58 vars in 1018 bytes} [Wed Aug 24 04:14:06 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:14:06.676295 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ed901-5383-4b30-8801-77d02f426dce None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:14:06.698027 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ed901-5383-4b30-8801-77d02f426dce None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:14:06.705144 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3673b71-ec19-4bc3-9163-ceca4ccf0644 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3796b1549762419686cb3b00af1a963e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:14:06.705832 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3673b71-ec19-4bc3-9163-ceca4ccf0644 service nova] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:14:06.706333 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3673b71-ec19-4bc3-9163-ceca4ccf0644 service nova] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:14:06.707270 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3673b71-ec19-4bc3-9163-ceca4ccf0644 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:14:06.730429 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3673b71-ec19-4bc3-9163-ceca4ccf0644 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:14:06.733696 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3673b71-ec19-4bc3-9163-ceca4ccf0644 service nova] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:14:06.758102 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 605/1229] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:14:06 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:14:16.629848 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=9 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:14:16.748065 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=6 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:14:19.889843 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ef21b-f41d-481e-9168-6d5fa3fa415f None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:14:19.890508 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ef21b-f41d-481e-9168-6d5fa3fa415f None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:14:19.890508 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ef21b-f41d-481e-9168-6d5fa3fa415f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:14:19.910973 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-588ef21b-f41d-481e-9168-6d5fa3fa415f None None] MFA Rules not processed for user `3ddbc5146c654e9eb59d57dcee789f4e`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:14:19.912250 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-588ef21b-f41d-481e-9168-6d5fa3fa415f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:14:19.920387 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 625/1230] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 24 04:14:19 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:14:20.267884 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35bd01-77dd-4474-bbe4-4bb9f046fa75 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:14:20.273410 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35bd01-77dd-4474-bbe4-4bb9f046fa75 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:14:20.273410 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35bd01-77dd-4474-bbe4-4bb9f046fa75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:14:20.289650 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-3d35bd01-77dd-4474-bbe4-4bb9f046fa75 None None] MFA Rules not processed for user `e62f90d6440048e58cf530701a979e87`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:14:20.290950 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-3d35bd01-77dd-4474-bbe4-4bb9f046fa75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:14:20.298318 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 606/1231] 10.222.0.15 () {58 vars in 1009 bytes} [Wed Aug 24 04:14:20 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:14:20.309963 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ef21b-f41d-481e-9168-6d5fa3fa415f None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:14:20.320164 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ef21b-f41d-481e-9168-6d5fa3fa415f None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:14:20.324088 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe4a4a-0602-4760-99dd-6e2d15332f28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62f90d6440048e58cf530701a979e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:14:20.324691 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe4a4a-0602-4760-99dd-6e2d15332f28 service neutron] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:14:20.324966 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe4a4a-0602-4760-99dd-6e2d15332f28 service neutron] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:14:20.325235 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe4a4a-0602-4760-99dd-6e2d15332f28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:14:20.332897 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fe4a4a-0602-4760-99dd-6e2d15332f28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:14:20.334340 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fe4a4a-0602-4760-99dd-6e2d15332f28 service neutron] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:14:20.342663 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 626/1232] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:14:20 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:14:30.284435 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=3 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:14:30.339174 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=9 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:14:47.902141 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5bfb3c-4384-4b1c-ba41-cbc873775f9c None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:14:47.902615 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5bfb3c-4384-4b1c-ba41-cbc873775f9c None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:14:47.902700 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5bfb3c-4384-4b1c-ba41-cbc873775f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:14:47.923156 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-5b5bfb3c-4384-4b1c-ba41-cbc873775f9c None None] MFA Rules not processed for user `3ddbc5146c654e9eb59d57dcee789f4e`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:14:47.924372 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-5b5bfb3c-4384-4b1c-ba41-cbc873775f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:14:47.932284 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 607/1233] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 24 04:14:47 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:14:57.917454 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=3 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:15:02.662997 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ab9ef-c1bd-42fe-93dc-754c81be1d72 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:15:02.663601 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ab9ef-c1bd-42fe-93dc-754c81be1d72 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:15:02.663601 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ab9ef-c1bd-42fe-93dc-754c81be1d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:15:02.684069 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-6a6ab9ef-c1bd-42fe-93dc-754c81be1d72 None None] MFA Rules not processed for user `3ddbc5146c654e9eb59d57dcee789f4e`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:15:02.685280 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-6a6ab9ef-c1bd-42fe-93dc-754c81be1d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:15:02.693427 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 627/1234] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 24 04:15:02 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:15:12.678716 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=3 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:16:04.384719 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a6281-718e-42a9-b15a-1925a9f178d4 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:04.385318 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a6281-718e-42a9-b15a-1925a9f178d4 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:04.385642 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a6281-718e-42a9-b15a-1925a9f178d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:04.414461 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-7f5a6281-718e-42a9-b15a-1925a9f178d4 None None] MFA Rules not processed for user `3ddbc5146c654e9eb59d57dcee789f4e`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:16:04.416408 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-7f5a6281-718e-42a9-b15a-1925a9f178d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:16:04.424195 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 608/1235] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 24 04:16:04 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:16:14.405477 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=3 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:16:19.864885 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ab9ef-c1bd-42fe-93dc-754c81be1d72 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:16:19.886853 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ab9ef-c1bd-42fe-93dc-754c81be1d72 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:16:19.891330 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188b400-6114-4677-ae5e-649dc69500e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62f90d6440048e58cf530701a979e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:16:19.892291 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188b400-6114-4677-ae5e-649dc69500e6 service neutron] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:16:19.892628 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188b400-6114-4677-ae5e-649dc69500e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:16:19.892917 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188b400-6114-4677-ae5e-649dc69500e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:16:19.904579 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e188b400-6114-4677-ae5e-649dc69500e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:16:19.906689 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e188b400-6114-4677-ae5e-649dc69500e6 service neutron] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:16:19.918030 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 628/1236] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:16:19 2022] GET /identity/v3/auth/tokens => generated 2883 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:16:29.913246 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=10 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:17:09.071743 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a6281-718e-42a9-b15a-1925a9f178d4 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:17:09.094133 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a6281-718e-42a9-b15a-1925a9f178d4 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:17:09.101703 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6a29a-786c-4886-bf02-62876783d6e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3f34384ad354405a69b3cfa242e9504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:17:09.102635 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6a29a-786c-4886-bf02-62876783d6e8 service placement] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:17:09.103059 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6a29a-786c-4886-bf02-62876783d6e8 service placement] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:17:09.103544 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6a29a-786c-4886-bf02-62876783d6e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:17:09.117955 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df6a29a-786c-4886-bf02-62876783d6e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:17:09.120768 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df6a29a-786c-4886-bf02-62876783d6e8 service placement] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:17:09.137134 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 609/1237] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:17:09 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:17:19.130202 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=10 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:26.900086 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188b400-6114-4677-ae5e-649dc69500e6 service neutron] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:26.922458 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188b400-6114-4677-ae5e-649dc69500e6 service neutron] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:26.927784 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382eff1-b07d-4d1e-be4d-3cbd231cb60d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3796b1549762419686cb3b00af1a963e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:26.928405 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382eff1-b07d-4d1e-be4d-3cbd231cb60d service nova] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:26.928678 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382eff1-b07d-4d1e-be4d-3cbd231cb60d service nova] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:26.928945 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382eff1-b07d-4d1e-be4d-3cbd231cb60d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:26.937867 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e382eff1-b07d-4d1e-be4d-3cbd231cb60d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:26.939826 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e382eff1-b07d-4d1e-be4d-3cbd231cb60d service nova] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:26.949289 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 629/1238] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:18:26 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:18:27.146364 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6a29a-786c-4886-bf02-62876783d6e8 service placement] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:27.156005 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6a29a-786c-4886-bf02-62876783d6e8 service placement] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:27.159497 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18fe91-8e9f-4ab6-9441-df3f8d20da1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62f90d6440048e58cf530701a979e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:27.160084 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18fe91-8e9f-4ab6-9441-df3f8d20da1b service neutron] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:27.160358 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18fe91-8e9f-4ab6-9441-df3f8d20da1b service neutron] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:27.160620 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18fe91-8e9f-4ab6-9441-df3f8d20da1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:27.170479 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18fe91-8e9f-4ab6-9441-df3f8d20da1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:27.171923 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18fe91-8e9f-4ab6-9441-df3f8d20da1b service neutron] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:27.182565 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 610/1239] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:18:27 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:18:28.385622 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382eff1-b07d-4d1e-be4d-3cbd231cb60d service nova] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:28.396841 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382eff1-b07d-4d1e-be4d-3cbd231cb60d service nova] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:28.400893 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa092b-72d9-4942-8dbb-0e61a5a049d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62f90d6440048e58cf530701a979e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:28.401486 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa092b-72d9-4942-8dbb-0e61a5a049d0 service neutron] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:28.401765 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa092b-72d9-4942-8dbb-0e61a5a049d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:28.402031 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa092b-72d9-4942-8dbb-0e61a5a049d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:28.413133 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa092b-72d9-4942-8dbb-0e61a5a049d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:28.414561 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa092b-72d9-4942-8dbb-0e61a5a049d0 service neutron] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:28.425233 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 630/1240] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:18:28 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:18:31.939409 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0550ce9-10f8-47e2-b536-389aae01141d None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:31.939956 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0550ce9-10f8-47e2-b536-389aae01141d None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:31.939956 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0550ce9-10f8-47e2-b536-389aae01141d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:31.960640 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-d0550ce9-10f8-47e2-b536-389aae01141d None None] MFA Rules not processed for user `3ddbc5146c654e9eb59d57dcee789f4e`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:31.961829 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-d0550ce9-10f8-47e2-b536-389aae01141d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:31.969660 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 611/1241] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 24 04:18:31 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:18:32.315770 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa092b-72d9-4942-8dbb-0e61a5a049d0 service neutron] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:32.324750 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa092b-72d9-4942-8dbb-0e61a5a049d0 service neutron] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:32.328863 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826ea19-ac9f-49ea-8aba-c1736584add4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62f90d6440048e58cf530701a979e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:32.329507 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826ea19-ac9f-49ea-8aba-c1736584add4 service neutron] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:32.329728 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826ea19-ac9f-49ea-8aba-c1736584add4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:32.329994 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826ea19-ac9f-49ea-8aba-c1736584add4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:32.337352 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9826ea19-ac9f-49ea-8aba-c1736584add4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:32.338768 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9826ea19-ac9f-49ea-8aba-c1736584add4 service neutron] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:32.347105 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 631/1242] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:18:32 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:18:32.826333 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0550ce9-10f8-47e2-b536-389aae01141d None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:32.839483 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0550ce9-10f8-47e2-b536-389aae01141d None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:32.844757 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e638f-7de1-496e-b12a-214aaa228039 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3f34384ad354405a69b3cfa242e9504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:32.845339 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e638f-7de1-496e-b12a-214aaa228039 service placement] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:32.845620 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e638f-7de1-496e-b12a-214aaa228039 service placement] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:32.845890 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e638f-7de1-496e-b12a-214aaa228039 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:32.855322 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e638f-7de1-496e-b12a-214aaa228039 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:32.856938 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e638f-7de1-496e-b12a-214aaa228039 service placement] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:32.867682 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 612/1243] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:18:32 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:18:40.441731 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826ea19-ac9f-49ea-8aba-c1736584add4 service neutron] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:40.455122 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826ea19-ac9f-49ea-8aba-c1736584add4 service neutron] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:40.461460 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc9feb-c542-476c-9223-b4e13466901d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3796b1549762419686cb3b00af1a963e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:40.462338 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc9feb-c542-476c-9223-b4e13466901d service nova] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:40.462620 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc9feb-c542-476c-9223-b4e13466901d service nova] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:40.462892 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc9feb-c542-476c-9223-b4e13466901d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:40.471580 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc9feb-c542-476c-9223-b4e13466901d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:40.473213 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc9feb-c542-476c-9223-b4e13466901d service nova] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:40.482658 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 632/1244] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:18:40 2022] GET /identity/v3/auth/tokens => generated 2818 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:18:40.991979 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e638f-7de1-496e-b12a-214aaa228039 service placement] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:41.004694 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e638f-7de1-496e-b12a-214aaa228039 service placement] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:41.013926 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4920dd-94ea-41db-87e6-26555bd1d82a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3796b1549762419686cb3b00af1a963e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:41.014655 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4920dd-94ea-41db-87e6-26555bd1d82a service nova] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:41.014996 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4920dd-94ea-41db-87e6-26555bd1d82a service nova] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:41.015934 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4920dd-94ea-41db-87e6-26555bd1d82a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:41.025794 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4920dd-94ea-41db-87e6-26555bd1d82a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:41.027455 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4920dd-94ea-41db-87e6-26555bd1d82a service nova] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:41.039668 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 613/1245] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:18:40 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:18:41.141587 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc9feb-c542-476c-9223-b4e13466901d service nova] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:18:41.153031 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc9feb-c542-476c-9223-b4e13466901d service nova] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:18:41.159514 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321db4a-189f-454a-b104-65363c975619 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62f90d6440048e58cf530701a979e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:18:41.163053 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321db4a-189f-454a-b104-65363c975619 service neutron] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:41.163383 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321db4a-189f-454a-b104-65363c975619 service neutron] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:41.163717 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321db4a-189f-454a-b104-65363c975619 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:41.175148 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7321db4a-189f-454a-b104-65363c975619 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:18:41.175148 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7321db4a-189f-454a-b104-65363c975619 service neutron] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:18:41.184488 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 633/1246] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:18:41 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:18:51.033845 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=21 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:51.180066 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=34 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:18:56.778736 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1072c-8acc-4651-aa1b-22597577943a None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:18:56.779475 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1072c-8acc-4651-aa1b-22597577943a None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:18:56.779475 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1072c-8acc-4651-aa1b-22597577943a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:18:56.805022 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-1de1072c-8acc-4651-aa1b-22597577943a None None] MFA Rules not processed for user `67fbe8bf4a4d442bae61628be7f8c8e8`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:18:56.806564 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-1de1072c-8acc-4651-aa1b-22597577943a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:18:56.816393 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 614/1247] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 24 04:18:56 2022] POST /identity/v3/auth/tokens => generated 2818 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:19:06.798373 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=3 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:11.114815 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321db4a-189f-454a-b104-65363c975619 service neutron] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:11.136009 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321db4a-189f-454a-b104-65363c975619 service neutron] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:11.143629 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e5dcb-8510-462b-b5f4-37ac5ecb2c7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3796b1549762419686cb3b00af1a963e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:11.144255 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e5dcb-8510-462b-b5f4-37ac5ecb2c7e service nova] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:11.144728 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e5dcb-8510-462b-b5f4-37ac5ecb2c7e service nova] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:11.144998 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e5dcb-8510-462b-b5f4-37ac5ecb2c7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:11.158010 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e5dcb-8510-462b-b5f4-37ac5ecb2c7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:11.159547 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e5dcb-8510-462b-b5f4-37ac5ecb2c7e service nova] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:11.180730 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 634/1248] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:19:11 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:19:17.803803 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de1072c-8acc-4651-aa1b-22597577943a None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:17.819040 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de1072c-8acc-4651-aa1b-22597577943a None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:17.825618 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f1cc4-85db-45f8-9b45-9edb0d9ce307 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3796b1549762419686cb3b00af1a963e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:17.826238 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f1cc4-85db-45f8-9b45-9edb0d9ce307 service nova] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:17.826517 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f1cc4-85db-45f8-9b45-9edb0d9ce307 service nova] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:17.826788 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f1cc4-85db-45f8-9b45-9edb0d9ce307 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:17.836088 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f1cc4-85db-45f8-9b45-9edb0d9ce307 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:17.837731 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f1cc4-85db-45f8-9b45-9edb0d9ce307 service nova] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:17.848519 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 615/1249] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:19:17 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:19:21.174199 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=6 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:26.192733 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e5dcb-8510-462b-b5f4-37ac5ecb2c7e service nova] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:19:26.206316 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e5dcb-8510-462b-b5f4-37ac5ecb2c7e service nova] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:19:26.210858 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f53f9-e771-43e1-9834-62dd4cadec8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62f90d6440048e58cf530701a979e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:19:26.211639 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f53f9-e771-43e1-9834-62dd4cadec8f service neutron] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:19:26.211920 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f53f9-e771-43e1-9834-62dd4cadec8f service neutron] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:19:26.212188 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f53f9-e771-43e1-9834-62dd4cadec8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:19:26.225530 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277f53f9-e771-43e1-9834-62dd4cadec8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:19:26.227825 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277f53f9-e771-43e1-9834-62dd4cadec8f service neutron] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:19:26.238608 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 635/1250] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:19:26 2022] GET /identity/v3/auth/tokens => generated 2887 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:19:27.844235 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=6 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:19:36.233807 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=6 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:20:39.674011 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453054e5-7fea-4fc7-a66b-e78df6e9dfaa None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:20:39.674594 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453054e5-7fea-4fc7-a66b-e78df6e9dfaa None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:20:39.674594 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453054e5-7fea-4fc7-a66b-e78df6e9dfaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:20:39.695148 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-453054e5-7fea-4fc7-a66b-e78df6e9dfaa None None] MFA Rules not processed for user `3ddbc5146c654e9eb59d57dcee789f4e`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:20:39.696392 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-453054e5-7fea-4fc7-a66b-e78df6e9dfaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:20:39.705119 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 616/1251] 10.222.0.15 () {58 vars in 958 bytes} [Wed Aug 24 04:20:39 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:20:40.044862 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f53f9-e771-43e1-9834-62dd4cadec8f service neutron] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:20:40.056131 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f53f9-e771-43e1-9834-62dd4cadec8f service neutron] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:20:40.061212 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5caa8-61ac-48d5-b0a9-46c84724940b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62f90d6440048e58cf530701a979e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:20:40.062119 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5caa8-61ac-48d5-b0a9-46c84724940b service neutron] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:20:40.062398 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5caa8-61ac-48d5-b0a9-46c84724940b service neutron] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:20:40.062669 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5caa8-61ac-48d5-b0a9-46c84724940b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:20:40.072697 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb5caa8-61ac-48d5-b0a9-46c84724940b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:20:40.074131 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb5caa8-61ac-48d5-b0a9-46c84724940b service neutron] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:20:40.082423 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 636/1252] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:20:40 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:20:49.689933 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=3 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:20:50.078965 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=6 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:21:59.244441 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453054e5-7fea-4fc7-a66b-e78df6e9dfaa None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:21:59.246377 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-453054e5-7fea-4fc7-a66b-e78df6e9dfaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:21:59.310121 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453054e5-7fea-4fc7-a66b-e78df6e9dfaa None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:21:59.314826 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01afc69-f1f8-4865-9fdf-56a4089929fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62f90d6440048e58cf530701a979e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:21:59.315493 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01afc69-f1f8-4865-9fdf-56a4089929fd service neutron] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:21:59.315811 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01afc69-f1f8-4865-9fdf-56a4089929fd service neutron] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:21:59.316073 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01afc69-f1f8-4865-9fdf-56a4089929fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:21:59.424769 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01afc69-f1f8-4865-9fdf-56a4089929fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:21:59.426177 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01afc69-f1f8-4865-9fdf-56a4089929fd service neutron] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:21:59.449867 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 617/1253] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:21:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:22:02.983169 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e852649-6a85-4bb4-aafa-809f0d2563d0 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:22:02.983815 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e852649-6a85-4bb4-aafa-809f0d2563d0 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:22:02.983994 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e852649-6a85-4bb4-aafa-809f0d2563d0 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:22:02.985395 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 637/1254] 10.222.0.15 () {54 vars in 921 bytes} [Wed Aug 24 04:22:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:22:03.016673 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd50534-8986-4115-9770-3088807675ea None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:22:03.017274 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd50534-8986-4115-9770-3088807675ea None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:22:03.017274 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd50534-8986-4115-9770-3088807675ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:22:03.104383 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-7cd50534-8986-4115-9770-3088807675ea None None] MFA Rules not processed for user `a3f34384ad354405a69b3cfa242e9504`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:22:03.105613 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-7cd50534-8986-4115-9770-3088807675ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:22:03.114486 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 618/1255] 10.222.0.15 () {58 vars in 1018 bytes} [Wed Aug 24 04:22:03 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:22:03.126870 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e852649-6a85-4bb4-aafa-809f0d2563d0 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:22:03.141183 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e852649-6a85-4bb4-aafa-809f0d2563d0 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:22:03.146820 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c7e42-b29a-4b75-aae1-5fd7ea10c94a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3f34384ad354405a69b3cfa242e9504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:22:03.147524 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c7e42-b29a-4b75-aae1-5fd7ea10c94a service placement] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:22:03.147896 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c7e42-b29a-4b75-aae1-5fd7ea10c94a service placement] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:22:03.148236 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c7e42-b29a-4b75-aae1-5fd7ea10c94a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:22:03.157252 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436c7e42-b29a-4b75-aae1-5fd7ea10c94a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:22:03.158932 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436c7e42-b29a-4b75-aae1-5fd7ea10c94a service placement] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:22:03.169025 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 638/1256] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:22:03 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:22:06.347596 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d772037-2b9e-4c33-81b2-9c69571b345e None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:22:06.348110 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d772037-2b9e-4c33-81b2-9c69571b345e None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:22:06.348110 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d772037-2b9e-4c33-81b2-9c69571b345e None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:22:06.349369 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 619/1257] 10.222.0.15 () {54 vars in 921 bytes} [Wed Aug 24 04:22:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:22:06.381815 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146de789-b22f-4c1c-aab1-285baadbe1cf None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:22:06.382336 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146de789-b22f-4c1c-aab1-285baadbe1cf None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:22:06.382419 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146de789-b22f-4c1c-aab1-285baadbe1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:22:06.402901 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-146de789-b22f-4c1c-aab1-285baadbe1cf None None] MFA Rules not processed for user `a3f34384ad354405a69b3cfa242e9504`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:22:06.404470 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-146de789-b22f-4c1c-aab1-285baadbe1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:22:06.411265 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d772037-2b9e-4c33-81b2-9c69571b345e None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:22:06.417217 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 639/1258] 10.222.0.15 () {58 vars in 1018 bytes} [Wed Aug 24 04:22:06 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:22:06.426375 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d772037-2b9e-4c33-81b2-9c69571b345e None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:22:06.433518 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f81edd-52f2-459a-98b5-6cc091128863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d781cc0590648468fbe68aed993b0f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:22:06.434448 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f81edd-52f2-459a-98b5-6cc091128863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:22:06.434629 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f81edd-52f2-459a-98b5-6cc091128863 admin admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:22:06.434954 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f81edd-52f2-459a-98b5-6cc091128863 admin admin] PATH_INFO: `/v3/users/67fbe8bf4a4d442bae61628be7f8c8e8` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:22:06.436966 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f81edd-52f2-459a-98b5-6cc091128863 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67fbe8bf4a4d442bae61628be7f8c8e8)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:22:06.437093 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146de789-b22f-4c1c-aab1-285baadbe1cf None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:22:06.439880 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f81edd-52f2-459a-98b5-6cc091128863 admin admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:22:06.450007 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146de789-b22f-4c1c-aab1-285baadbe1cf None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:22:06.456172 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b1f2c-87b5-49c5-a615-f42849333091 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3f34384ad354405a69b3cfa242e9504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:22:06.456786 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b1f2c-87b5-49c5-a615-f42849333091 service placement] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:22:06.457153 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b1f2c-87b5-49c5-a615-f42849333091 service placement] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:22:06.457433 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b1f2c-87b5-49c5-a615-f42849333091 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:22:06.465090 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:22:06.466895 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b1f2c-87b5-49c5-a615-f42849333091 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:22:06.468545 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5b1f2c-87b5-49c5-a615-f42849333091 service placement] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:22:06.479143 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 640/1259] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:22:06 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:22:06.493488 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-98f81edd-52f2-459a-98b5-6cc091128863 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67fbe8bf4a4d442bae61628be7f8c8e8'} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:22:06.494264 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-98f81edd-52f2-459a-98b5-6cc091128863 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67fbe8bf4a4d442bae61628be7f8c8e8'} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:22:06.503532 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-98f81edd-52f2-459a-98b5-6cc091128863 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67fbe8bf4a4d442bae61628be7f8c8e8'} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:22:06.504198 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-98f81edd-52f2-459a-98b5-6cc091128863 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67fbe8bf4a4d442bae61628be7f8c8e8'} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:22:06.511808 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-98f81edd-52f2-459a-98b5-6cc091128863 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67fbe8bf4a4d442bae61628be7f8c8e8'} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:22:06.530629 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 620/1260] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 24 04:22:06 2022] DELETE /identity/v3/users/67fbe8bf4a4d442bae61628be7f8c8e8 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:22:06.728240 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b1f2c-87b5-49c5-a615-f42849333091 service placement] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:22:06.744297 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b1f2c-87b5-49c5-a615-f42849333091 service placement] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:22:06.808103 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ee8b1-ecec-408a-b815-0b5456d443a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d781cc0590648468fbe68aed993b0f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:22:06.808745 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ee8b1-ecec-408a-b815-0b5456d443a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:22:06.809028 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ee8b1-ecec-408a-b815-0b5456d443a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:22:06.809301 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ee8b1-ecec-408a-b815-0b5456d443a7 admin admin] PATH_INFO: `/v3/projects/e7c39e51c0174f8d9fe9964a40aeba2b` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:22:06.810526 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ee8b1-ecec-408a-b815-0b5456d443a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7c39e51c0174f8d9fe9964a40aeba2b)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:22:06.812799 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ee8b1-ecec-408a-b815-0b5456d443a7 admin admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:22:06.867139 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-789ee8b1-ecec-408a-b815-0b5456d443a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7c39e51c0174f8d9fe9964a40aeba2b', 'request_id': 'req-789ee8b1-ecec-408a-b815-0b5456d443a7'} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:22:06.875831 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-789ee8b1-ecec-408a-b815-0b5456d443a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7c39e51c0174f8d9fe9964a40aeba2b', 'request_id': 'req-789ee8b1-ecec-408a-b815-0b5456d443a7'} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:22:06.882363 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-789ee8b1-ecec-408a-b815-0b5456d443a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7c39e51c0174f8d9fe9964a40aeba2b', 'request_id': 'req-789ee8b1-ecec-408a-b815-0b5456d443a7'} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:22:06.905708 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-789ee8b1-ecec-408a-b815-0b5456d443a7 admin admin] The token cache is being invalidate because project e7c39e51c0174f8d9fe9964a40aeba2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:22:06.906006 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-789ee8b1-ecec-408a-b815-0b5456d443a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:22:06.906672 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-789ee8b1-ecec-408a-b815-0b5456d443a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:22:06.908210 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 641/1261] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 24 04:22:06 2022] DELETE /identity/v3/projects/e7c39e51c0174f8d9fe9964a40aeba2b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:22:06.913004 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f81edd-52f2-459a-98b5-6cc091128863 admin admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:22:06.914465 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-98f81edd-52f2-459a-98b5-6cc091128863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:22:06.928441 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f81edd-52f2-459a-98b5-6cc091128863 admin admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:22:06.988818 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07bb38-4fca-449d-be22-3a8e33f8aa0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d781cc0590648468fbe68aed993b0f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:22:06.989449 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07bb38-4fca-449d-be22-3a8e33f8aa0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:22:06.989765 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07bb38-4fca-449d-be22-3a8e33f8aa0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:22:06.990035 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07bb38-4fca-449d-be22-3a8e33f8aa0c admin admin] PATH_INFO: `/v3/users/c34baefa97b4409f9e8a0c9b78ffa4db` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:22:06.991155 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e07bb38-4fca-449d-be22-3a8e33f8aa0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c34baefa97b4409f9e8a0c9b78ffa4db)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:22:06.993144 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e07bb38-4fca-449d-be22-3a8e33f8aa0c admin admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:22:07.044918 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-9e07bb38-4fca-449d-be22-3a8e33f8aa0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c34baefa97b4409f9e8a0c9b78ffa4db'} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:22:07.045571 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-9e07bb38-4fca-449d-be22-3a8e33f8aa0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c34baefa97b4409f9e8a0c9b78ffa4db'} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:22:07.057064 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-9e07bb38-4fca-449d-be22-3a8e33f8aa0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c34baefa97b4409f9e8a0c9b78ffa4db'} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:22:07.057690 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-9e07bb38-4fca-449d-be22-3a8e33f8aa0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c34baefa97b4409f9e8a0c9b78ffa4db'} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:22:07.066991 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-9e07bb38-4fca-449d-be22-3a8e33f8aa0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c34baefa97b4409f9e8a0c9b78ffa4db'} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:22:07.089169 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 621/1262] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 24 04:22:06 2022] DELETE /identity/v3/users/c34baefa97b4409f9e8a0c9b78ffa4db => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:22:07.290352 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ee8b1-ecec-408a-b815-0b5456d443a7 admin admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:22:07.292130 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-789ee8b1-ecec-408a-b815-0b5456d443a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:22:07.306665 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ee8b1-ecec-408a-b815-0b5456d443a7 admin admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:22:07.358188 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:22:07.372419 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8531b-737a-4205-9725-3bdf0bff827d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d781cc0590648468fbe68aed993b0f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:22:07.373197 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8531b-737a-4205-9725-3bdf0bff827d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:22:07.373466 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8531b-737a-4205-9725-3bdf0bff827d admin admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:22:07.373744 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8531b-737a-4205-9725-3bdf0bff827d admin admin] PATH_INFO: `/v3/projects/9a9ad55fe6b24c7eaa3a40953a2a5e2e` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:22:07.374890 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd8531b-737a-4205-9725-3bdf0bff827d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a9ad55fe6b24c7eaa3a40953a2a5e2e)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:22:07.376842 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd8531b-737a-4205-9725-3bdf0bff827d admin admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:22:07.427510 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-ecd8531b-737a-4205-9725-3bdf0bff827d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a9ad55fe6b24c7eaa3a40953a2a5e2e', 'request_id': 'req-ecd8531b-737a-4205-9725-3bdf0bff827d'} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:22:07.437222 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-ecd8531b-737a-4205-9725-3bdf0bff827d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a9ad55fe6b24c7eaa3a40953a2a5e2e', 'request_id': 'req-ecd8531b-737a-4205-9725-3bdf0bff827d'} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:22:07.446670 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-ecd8531b-737a-4205-9725-3bdf0bff827d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a9ad55fe6b24c7eaa3a40953a2a5e2e', 'request_id': 'req-ecd8531b-737a-4205-9725-3bdf0bff827d'} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:22:07.461685 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-ecd8531b-737a-4205-9725-3bdf0bff827d admin admin] The token cache is being invalidate because project 9a9ad55fe6b24c7eaa3a40953a2a5e2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88431) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:22:07.461873 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-ecd8531b-737a-4205-9725-3bdf0bff827d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:22:07.462676 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-ecd8531b-737a-4205-9725-3bdf0bff827d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:22:07.464841 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 642/1263] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 24 04:22:07 2022] DELETE /identity/v3/projects/9a9ad55fe6b24c7eaa3a40953a2a5e2e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:22:15.025871 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07bb38-4fca-449d-be22-3a8e33f8aa0c admin admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:22:15.028036 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-9e07bb38-4fca-449d-be22-3a8e33f8aa0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:22:15.055760 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:22:15.109017 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07bb38-4fca-449d-be22-3a8e33f8aa0c admin admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:22:15.177829 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e932bae-f2b6-497d-93d6-46fe4d10120b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3f34384ad354405a69b3cfa242e9504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:22:15.178668 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e932bae-f2b6-497d-93d6-46fe4d10120b service placement] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:22:15.179118 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e932bae-f2b6-497d-93d6-46fe4d10120b service placement] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:22:15.179555 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e932bae-f2b6-497d-93d6-46fe4d10120b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:22:15.182563 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-7e932bae-f2b6-497d-93d6-46fe4d10120b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:22:15.198486 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e932bae-f2b6-497d-93d6-46fe4d10120b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:22:15.200148 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e932bae-f2b6-497d-93d6-46fe4d10120b service placement] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:22:15.210403 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 622/1264] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:22:15 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:22:17.457123 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=30,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:22:25.206483 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=49 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:23:26.068878 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8531b-737a-4205-9725-3bdf0bff827d admin admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:23:26.070492 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-ecd8531b-737a-4205-9725-3bdf0bff827d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:26.152138 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8531b-737a-4205-9725-3bdf0bff827d admin admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:23:26.156182 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df89cdf-f8f9-4c31-bc1d-17830996356d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d60ca48fd1b4a4ab4261ad1dbd6c8bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:23:26.156811 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df89cdf-f8f9-4c31-bc1d-17830996356d service cinder] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:26.157085 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df89cdf-f8f9-4c31-bc1d-17830996356d service cinder] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:26.157343 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df89cdf-f8f9-4c31-bc1d-17830996356d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:26.159225 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-8df89cdf-f8f9-4c31-bc1d-17830996356d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:26.245409 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df89cdf-f8f9-4c31-bc1d-17830996356d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:23:26.246872 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df89cdf-f8f9-4c31-bc1d-17830996356d service cinder] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:23:26.264716 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 643/1265] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:23:26 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:23:27.575040 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e932bae-f2b6-497d-93d6-46fe4d10120b service placement] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:23:27.576815 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-7e932bae-f2b6-497d-93d6-46fe4d10120b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:27.647871 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e932bae-f2b6-497d-93d6-46fe4d10120b service placement] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:23:27.652373 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1811a17-36bf-478e-bdf0-60ca72df9467 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e62f90d6440048e58cf530701a979e87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:23:27.652995 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1811a17-36bf-478e-bdf0-60ca72df9467 service neutron] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:27.653270 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1811a17-36bf-478e-bdf0-60ca72df9467 service neutron] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:27.653536 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1811a17-36bf-478e-bdf0-60ca72df9467 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:27.655504 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-f1811a17-36bf-478e-bdf0-60ca72df9467 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:27.722840 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1811a17-36bf-478e-bdf0-60ca72df9467 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:23:27.724378 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1811a17-36bf-478e-bdf0-60ca72df9467 service neutron] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:23:27.734235 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 623/1266] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:23:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:23:34.386843 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df89cdf-f8f9-4c31-bc1d-17830996356d service cinder] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:23:34.389127 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-8df89cdf-f8f9-4c31-bc1d-17830996356d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:34.409295 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df89cdf-f8f9-4c31-bc1d-17830996356d service cinder] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:23:34.417072 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73d3ee-da4c-4588-b12b-c08dda33f6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d781cc0590648468fbe68aed993b0f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:23:34.418085 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73d3ee-da4c-4588-b12b-c08dda33f6e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:34.418452 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73d3ee-da4c-4588-b12b-c08dda33f6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:34.418834 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73d3ee-da4c-4588-b12b-c08dda33f6e3 admin admin] PATH_INFO: `/v3/users/3ddbc5146c654e9eb59d57dcee789f4e` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:34.420949 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e73d3ee-da4c-4588-b12b-c08dda33f6e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ddbc5146c654e9eb59d57dcee789f4e)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:23:34.422673 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: WARNING py.warnings [None req-2e73d3ee-da4c-4588-b12b-c08dda33f6e3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:23:34.422673 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: warnings.warn(msg) Aug 24 04:23:34.422673 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: Aug 24 04:23:34.424337 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e73d3ee-da4c-4588-b12b-c08dda33f6e3 admin admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:23:34.498851 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-2e73d3ee-da4c-4588-b12b-c08dda33f6e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ddbc5146c654e9eb59d57dcee789f4e'} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:23:34.499585 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-2e73d3ee-da4c-4588-b12b-c08dda33f6e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ddbc5146c654e9eb59d57dcee789f4e'} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:23:34.509817 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-2e73d3ee-da4c-4588-b12b-c08dda33f6e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ddbc5146c654e9eb59d57dcee789f4e'} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:23:34.519806 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:23:34.523043 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-2e73d3ee-da4c-4588-b12b-c08dda33f6e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ddbc5146c654e9eb59d57dcee789f4e'} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:23:34.524647 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-2e73d3ee-da4c-4588-b12b-c08dda33f6e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ddbc5146c654e9eb59d57dcee789f4e'} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:23:34.552333 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 644/1267] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 24 04:23:34 2022] DELETE /identity/v3/users/3ddbc5146c654e9eb59d57dcee789f4e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:23:34.741749 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1811a17-36bf-478e-bdf0-60ca72df9467 service neutron] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:23:34.758916 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1811a17-36bf-478e-bdf0-60ca72df9467 service neutron] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:23:34.835995 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a93aba0-4ea1-4da5-91cd-436881be5d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d781cc0590648468fbe68aed993b0f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:23:34.836685 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93aba0-4ea1-4da5-91cd-436881be5d3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:34.836966 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93aba0-4ea1-4da5-91cd-436881be5d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:34.837238 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a93aba0-4ea1-4da5-91cd-436881be5d3e admin admin] PATH_INFO: `/v3/projects/4ce50eef9241499eb5528e8b2778ee22` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:34.838510 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a93aba0-4ea1-4da5-91cd-436881be5d3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ce50eef9241499eb5528e8b2778ee22)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:23:34.839630 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: WARNING py.warnings [None req-3a93aba0-4ea1-4da5-91cd-436881be5d3e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:23:34.839630 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: warnings.warn(msg) Aug 24 04:23:34.839630 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: Aug 24 04:23:34.840875 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a93aba0-4ea1-4da5-91cd-436881be5d3e admin admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:23:34.901651 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-3a93aba0-4ea1-4da5-91cd-436881be5d3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ce50eef9241499eb5528e8b2778ee22', 'request_id': 'req-3a93aba0-4ea1-4da5-91cd-436881be5d3e'} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:23:34.909838 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:23:34.916413 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-3a93aba0-4ea1-4da5-91cd-436881be5d3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ce50eef9241499eb5528e8b2778ee22', 'request_id': 'req-3a93aba0-4ea1-4da5-91cd-436881be5d3e'} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:23:34.923893 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-3a93aba0-4ea1-4da5-91cd-436881be5d3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ce50eef9241499eb5528e8b2778ee22', 'request_id': 'req-3a93aba0-4ea1-4da5-91cd-436881be5d3e'} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:23:34.939116 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-3a93aba0-4ea1-4da5-91cd-436881be5d3e admin admin] The token cache is being invalidate because project 4ce50eef9241499eb5528e8b2778ee22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:23:34.939444 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-3a93aba0-4ea1-4da5-91cd-436881be5d3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:23:34.940130 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-3a93aba0-4ea1-4da5-91cd-436881be5d3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:23:34.941675 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 624/1268] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 24 04:23:34 2022] DELETE /identity/v3/projects/4ce50eef9241499eb5528e8b2778ee22 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:23:34.945963 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73d3ee-da4c-4588-b12b-c08dda33f6e3 admin admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:23:34.947506 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-2e73d3ee-da4c-4588-b12b-c08dda33f6e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:34.961980 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73d3ee-da4c-4588-b12b-c08dda33f6e3 admin admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:23:35.023527 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173eaff2-97d7-47d0-add1-4e27bb8ea95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d781cc0590648468fbe68aed993b0f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:23:35.024180 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173eaff2-97d7-47d0-add1-4e27bb8ea95f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:35.024485 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173eaff2-97d7-47d0-add1-4e27bb8ea95f admin admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:35.024762 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173eaff2-97d7-47d0-add1-4e27bb8ea95f admin admin] PATH_INFO: `/v3/users/105cb9fdad5c48eeb4eb8eefa47c7de2` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:35.039830 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173eaff2-97d7-47d0-add1-4e27bb8ea95f admin admin] RBAC: Authorizing `identity:delete_user(user_id=105cb9fdad5c48eeb4eb8eefa47c7de2)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:23:35.041889 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173eaff2-97d7-47d0-add1-4e27bb8ea95f admin admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:23:35.096867 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-173eaff2-97d7-47d0-add1-4e27bb8ea95f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '105cb9fdad5c48eeb4eb8eefa47c7de2'} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:23:35.097555 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-173eaff2-97d7-47d0-add1-4e27bb8ea95f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '105cb9fdad5c48eeb4eb8eefa47c7de2'} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:23:35.106165 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-173eaff2-97d7-47d0-add1-4e27bb8ea95f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '105cb9fdad5c48eeb4eb8eefa47c7de2'} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:23:35.114033 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-173eaff2-97d7-47d0-add1-4e27bb8ea95f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '105cb9fdad5c48eeb4eb8eefa47c7de2'} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:23:35.114765 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-173eaff2-97d7-47d0-add1-4e27bb8ea95f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '105cb9fdad5c48eeb4eb8eefa47c7de2'} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:23:35.135119 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 645/1269] 10.222.0.15 () {58 vars in 1224 bytes} [Wed Aug 24 04:23:34 2022] DELETE /identity/v3/users/105cb9fdad5c48eeb4eb8eefa47c7de2 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:23:35.322483 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a93aba0-4ea1-4da5-91cd-436881be5d3e admin admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:23:35.324173 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-3a93aba0-4ea1-4da5-91cd-436881be5d3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:23:35.338244 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a93aba0-4ea1-4da5-91cd-436881be5d3e admin admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:23:35.399214 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df0f50-67ed-4430-9f24-f19adc8ff0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c414fa8ffb744c22a2619f1ccb5b8577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d781cc0590648468fbe68aed993b0f3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:23:35.399919 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df0f50-67ed-4430-9f24-f19adc8ff0f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:23:35.400181 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df0f50-67ed-4430-9f24-f19adc8ff0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:23:35.400461 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df0f50-67ed-4430-9f24-f19adc8ff0f9 admin admin] PATH_INFO: `/v3/projects/f8557a7fa311447bba15d420a00d3546` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:23:35.411471 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df0f50-67ed-4430-9f24-f19adc8ff0f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8557a7fa311447bba15d420a00d3546)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:23:35.413436 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df0f50-67ed-4430-9f24-f19adc8ff0f9 admin admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:23:35.465568 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-b7df0f50-67ed-4430-9f24-f19adc8ff0f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8557a7fa311447bba15d420a00d3546', 'request_id': 'req-b7df0f50-67ed-4430-9f24-f19adc8ff0f9'} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:23:35.472422 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-b7df0f50-67ed-4430-9f24-f19adc8ff0f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8557a7fa311447bba15d420a00d3546', 'request_id': 'req-b7df0f50-67ed-4430-9f24-f19adc8ff0f9'} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:23:35.478667 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-b7df0f50-67ed-4430-9f24-f19adc8ff0f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8557a7fa311447bba15d420a00d3546', 'request_id': 'req-b7df0f50-67ed-4430-9f24-f19adc8ff0f9'} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:23:35.494266 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-b7df0f50-67ed-4430-9f24-f19adc8ff0f9 admin admin] The token cache is being invalidate because project f8557a7fa311447bba15d420a00d3546 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:23:35.494813 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-b7df0f50-67ed-4430-9f24-f19adc8ff0f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:23:35.495451 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-b7df0f50-67ed-4430-9f24-f19adc8ff0f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:23:35.497064 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 625/1270] 10.222.0.15 () {58 vars in 1233 bytes} [Wed Aug 24 04:23:35 2022] DELETE /identity/v3/projects/f8557a7fa311447bba15d420a00d3546 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:23:45.131121 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=66,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:23:45.489611 dv-osbrick-854281-1-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=60,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:27:17.978644 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173eaff2-97d7-47d0-add1-4e27bb8ea95f admin admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:27:17.980638 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-173eaff2-97d7-47d0-add1-4e27bb8ea95f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:27:18.081783 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173eaff2-97d7-47d0-add1-4e27bb8ea95f admin admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:27:18.149542 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c779aea-87d1-4788-81ce-88040eefec1f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3f34384ad354405a69b3cfa242e9504', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c317b3ce1d1468f95bc01ba2587e623', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:27:18.150180 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c779aea-87d1-4788-81ce-88040eefec1f service placement] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:27:18.150450 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c779aea-87d1-4788-81ce-88040eefec1f service placement] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:27:18.150716 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c779aea-87d1-4788-81ce-88040eefec1f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:27:18.152616 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-6c779aea-87d1-4788-81ce-88040eefec1f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:27:18.164473 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c779aea-87d1-4788-81ce-88040eefec1f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:27:18.166114 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c779aea-87d1-4788-81ce-88040eefec1f service placement] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:27:18.176590 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 646/1271] 10.222.0.15 () {60 vars in 1365 bytes} [Wed Aug 24 04:27:17 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:27:28.172151 dv-osbrick-854281-1-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=62 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}